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ABSTBACT 

The report is a third party audit/evaluation of a 
research and development project to .provide curriculum and staff 
development for the iiple mentation of a high school career 
development program in two career clusters at the Washington, D.C, 
Lemuel A. Penn Career Development Center. A project overview is 
presented; maj^or responsibilities of the evaluation ^team ar^ 
outlined; and tl^e findings, 'conclusions, and recommendations 
detailed. The late date of contract approval for the evaluation meant 
that the evaluation team was not involved in the project until it wa*s 
almost completed, and personal visitation at the staff training 
workshops was limited. Principal data%collection instruments were 'a 
participant questionnaire developed from the^training objectives, 
interviews with project staff, and review of all ^vaileble documents 
and* materials relating to the project and training workshops. Besults, 
of the questionnaire survej are detailed in both narrative and 
tabular fom. Based upon analysis of evaluation findings, jiain 
conclusions were that the major objectives of the BCX consulting team 
in workshop training were met, but that the overall program plan and 
stated objectives were too extensive to be accomplished in the time 
period allowed. -Hore planning and project development should be 
implemented. (BG)' 
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SECTlbN I — OVERVIEW / 

This research and* development project was funded under the Office ' 
of Education grant number OEG-0-73-1234 to provide the D. C. Publ/c Schoojs 
with planning and evaluating capabilities for the implementation of a high 
school career development Jjljgram in the Lemuel A. Penn Career Development 
Center. Specifically, this project was designed to provide the "curriculum * 

K 

and staff development for two career clusters: communications and media • 
firts. arts and humanities." The intent is to establish two interrelated pilot 
career clusters of career developmerj^^^ograms designed to provide job 
preparation in communications and media; rine arts and humanities; Students 
enrolled in the academic and vocational high schools who wish to pursue 

• studies in communications and medi4< fine' arts and humanities cluster's will 
be released from the high schrfolsf to study part-time in the Lemuel A, 'penn - 
Center. The site of the project will be the former National Geographic 
building, a facility that was acquired by the^. C. Public Schools for 
expansion of career development programs at the secondary ^evel and which 
has now been officially designated' as the Lemuel A. Penn Center. The 
designated center is at- Third and R Streets, N.E., which is centrally located 
within the school district and offers ready accessibility to the students in 
the twelve academic and five vocational high> schools located throughout the 
District of Columbia. ' , , 

The two week workshop for Curriculum and Staff Development conducted 
August 20-31, 1973 was originally scheduled as a'^ix week worfehoj and 

was to have started July 9, and continued through August 17, 1973. Inability 
to obtain contractual assistance in the training of project staff and 

\ 
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teachers was the first in a number of situations which fventuall^ made ' 

tlie {xroject stretch out through Nay 30^, i9jJ4. . In this pHase of 'the project, 

jf. nucleus of four staff persons and appf{)ximately f if teen^teachers, 

« 

including* t|ie principal to be assigned to the Caree^ Center wer^ *to engage 
in an intensive period of trailing and; curriculum planning. y 

As initially approved and presented' to the D.S, Office of Education, 
the following' project activities' were to be'carried out:^ 

1, Job survey^ aivi training require^nts, ^ ^ 

Review mainpower stud^ies and suiVeys of the fine ^rts agehcies 

" and institutions and the graphic arts industries to determine the kinds of 

* ' » ' . 

jobs and j6b opportunities ayailable to young people, 

• • « 

b. Determine the type and quality of training th^ is required far 

( 

entry level jobs in industry, ^ ' 

c. Review 'curriculum and other materials that are Available within 
the present school system for use in these p^ftgrams. 

d. Develop am overall structure through which each program element 
caj\ Interact while shaoring the resources and facilities, 

2. Develop curriculum outlines for each instructional component within 
the two career clusters. . . ' 

^ 3t Prepare individual learning packages -or units within the program 
components. ^ 

4, Develop a meaningful prograaa of production activities to enhance 
the instructional programs. . The students were to receive a maximum of 

V 4 

practical experience in producing materialsr^ or. distribution in the schools 

f * . / 

and community. ^ . ♦ ' 

N . 7 • . 



5. Devise a plsLn for evaluating the piK^gram: 

a. Collect and review various types of evaluation criteria and 
instruine»t$ designed to evaluate studenty^rf ormance. Determine, possible 
Use in these programs. / 

b. Devise ot)ier special tests suid evaluation devices necessary . 
to determine student performance and progress, 

c. Devise a ffeSm for the periodic conduct of outside^^third party) 
evaiuations. Develop a lifting of agencies auid/or institutions capable of 
^uch evaluations, .particularly with the emphasis of determining the success 
of "program graduate placement based upop training qualification of job 
performance and emplojanent adViaiicement, ' ' . • 

6, Suggest a means foi: continuous plstnning after Implementation of 
the clusters, 

7. Develop ^program promotion and public j^elations, . r- 

8, Suggest .workable schedules f or Mgh schools in order that students 
may have the opportunity to attend the Center, ' *' , ' 

. 9. Explore the possibilities of students receiving maximum credit for 
study in the Center, Review jinit requirements for electives with respect 
to ov^^rall .requirements for gi^aduation, 

10, ,Plan a system for tlrajisporting students between the Center and 
the high schools. ' . • ' ' ^ ^ 

\ ir. Develop a plan for a store through which students can sell their 
produf:ts as created in the'studios, laboratories and workshops, (This activity 
to be correlated with tfitv^Distributive Education Programs), ' - * ' 

12. Develop a schedule and timetable for accomplishing certain goals ' 
and objecti\|es. * ^ ^ ^ . 
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13. Plan and organizeua counseling service for the Center, (This 
service is to be correlated vriLth the overall Career Development Counseling' 
Program). ■ ' ^ 

14. Review fetaff requl2remen%6 and de.terinine qualifications of per- 
sonnel. Suggest proce4ures for recruiting $taff , Review qiialiSrications 
of existin^'^^aff and determine staff development needs. 

1^ Develop a master plain for cu2;c:icul"Um suid staff d^lopment 
to be implemenied in cooperation with the Bachelor of Science Degroe in 
the t'eaching of technology program at Washington Technipal Institute. 

16. Identify consultants to serve as advisorSy^d ev^JLuators of the 
project. Make initial contacts to determine thei/ availability for service 
and devise a schedule of activitiW to utilize^hose services. 

17. Selection of studehts and\ student participation. 

a. Proposed j^ogram develdpraent is to serve approximately 600 
studehts during Hhe .f'irst year of operation, September, 1973 through 
August,. 197^. 

b. Students interested in pursuing the activities offered through 
the Center progzrams will be encouraged to enroll. Students will be registered 
in the '12 academic high schools, ^the five vocational high schools, the 

Workshops for the Careers in th? Arts, the Literary Arts Prograjn, and the • 

i 

Urban Communications Workshop. [ . 

Process Objectives enumerated as planned or in-being /s of February 26^ / 
1973 were: ^ • 

1. A p|aniting committee had been organised to work out the basic 
framework for the overall planning activitiesT 

> a. *Make up of tll>0-^ommittee cozj^isted "of/students, teachers, • 
supervisors, and community representativfefi. 



b. THe focus of effort nas on 1) raethods and techniques f br 
developing maximum articulation ajid cooperation betwe^ program elements, . 

' ' ■ ' 

and, 2) on proper utilization of space and other resqurce^s, 

• • ' - . A 

2. kCi advisory committee on the pilot clusters; communication end ♦ 

■ ^ / 

taedici— fine arts and humanities, was being established, 

a, V Msike up of the coraiTfJ.ttee would include representative^ from 

the Board of. Trade, Civil Service Commission,' local business and industry,. . 
cultural institutions and agencies amd private and public ^chpols. 

b. The committee would be responsible to 1) recommend .overall 
program needs (through an on-going evaduatiye process), stnd 2) assist in 
developing cooperative training and pla<!fement opportunities. , ' : 

3. The Project Director (P/bj^^ould carry out the immediate respons|- 
bilities for the overall planning ^effort, 

a. The P/d would ,work closely, with all depa2;;traents having direct 
involvement with the project, ' , ^ , ' * w / 

b. The P/D would be directly responsible to the. Assistant 
Superintendent, Department of Career Development Programs* 

c. The P/d would be responsible for, coordinating the program wll^th 
related activities in the high schools, ^ 

^ Center guidance and counseling services* would be correlated with the 

on-going guidance and counseling services of the Department, of Career 

» * * 

Development Program and the public schools. ^ 

a. Guidance service would be provided to assist students in sal^tis- 
fying psychological, social and ceireer needs, . : . * 

b. Guidsmce services would be so designed to aid students who seek 
employment immediately upon completion of high school a6 well a^ those who 
plan to continue their education. \ 

10 : ' ■ 



c; Students would receive systeniatic assistance in career' 
planning, placement and follow-up service in the development of goals 
and choices related to their edupational and career futures. Services 
would include; 1) provision of information about .career opportunities, 
•2) he^i)g. students determine if opportunities $\iit them, suid, 3) helping 
students tiike proper steps to achieve (^^esired goals, 

d, Guidance service would have a primary focus upon: 1) creating, 
- understanding of 'many problems that confront students in their immediate 
(short-range) and long-range planning, 2) working out a means of coping 
with or determining the solutions to their problems; and 3) emphasizing 
career planning, by giving the student assistance ip thinking through the 
short-range, as well as,-'the long-r^ge goals^ > ' • 

5t Design of all project components would be in such a manner as to 

ii^yhasize a careful measurement of student outcomes in relation to ,the 

* *^ ' 

treatments attempted and to provide for appropriate program revisions where 
indicated} ' 1) to internally develop assessment techniques in each componen.t, 
and, 2) install i)rocedj;res for recycling and revision of the various treat- 
ments tried until the desired student outcomes stre attained, ^ 

6, . To maintain accurate documentation with regard to the exact 
methods and procedures which are used, to include the associated costs, so 
as to yield data essential .to judging the potential trarisportabil^ty of 
successful components, 

7, The initial research .and developm^t funds under Part C would 
provide the District necessary support to a^ui:e the careful planning and 
coordination of this overall effort. The duration of this project would 
be six weeks, beginning July 9, 1973 and continuing through August 17, I973, 

If ■ ' ■ ' ■ 
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The plans then, as indicated, Hete to use the grant for sibaff and 
curriculum development for the Lemuel Penn Center programs. The Acting 
Project Director continued to pursue the inili^ial funding for this project . 
through an extend^' period of personal conferences and lett.ers tomDllow' 
up the original letter of assurance from the Di^rict of Columbia iir 
accordance with 'the Section 13^ of Part C of Public Law 9&-576,,/ Aftei 
severed delays and budget revisions, to include cost sharing. vith state 
and/or local funds for the project, the District ^ ColulJtiiia Proposal No. 
V36IO59L was approved alnd the grant awarded by the IVjS, Office of jSducation 
as; Grant Number DSG-?3-:2992/ * • " '^ ^ 

^ With this , approval action and. grauit, the Project Director coulc^ then 

proceed with the cooixlination of the initial apprWed proposal activities 
•sold ther s;election »and contapt of consultants tb^acpomplish the contract 
/^i:vlces in tjhe "development of the piloli career education cluster program ^ ^ 
in the ,irea of fiiie arts anc^umanifeiesTCommunic^tions and media. Contact 
was made with Dr. T.. E; Smith, manager 0% cuirrlculum, RCA Southwest Regional" 
Office, Dallas', Texas/* initial' planning sessions regarding personnel ,j 

and required s'ervic^fes, the decision was made to conduct the required work- 
shops in two phases, "fhis decisi^on to modify the initially planned six \ 

weeks workshop was the result of the extension of 'grant approval, delay 

" ^ * * 

^ in obtaining contract services from RCA, delay in the review and selection 
process *of teachers and the availability of teachers Twho would receive the * 
staff development training. Phase one of the sfaff development* and curri-r 

[ 

culum project was conducted by the RCA Servici Company staff during the two 
week period o*f August 20-31, 1973'. The efforts of the RCA Education Services 
group, the fdur D.C. Public Schools staff members and the 15-20 participalflng ^ 
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teacher/trainees axe reported in a Fingtl RuK Staff development Consulting 
Report dated DecepAer 26, 1973. In addition tb the. two weeks in August, 
the program was extended for two days, October 11-12, 1973. In this 
Phase I of the program, the RCA team was to provide "assistance in the 
development of a pilot career education ^cluster pro^raja" suid "in preliraineiry 
steps jiecessary *to the cSfevelopment qf a, comprehensive program- — concentrated 
on the major objectives listed beloK: 

If To determine the ?:inds of job oppor;tunities that 'are availably to 
young peoplfjin the fi^e arts and graphic ^rts occupations , by reviewing' 
manpower studies and surveys of fine arts agencies atnd institutions and 
graphic arts industries, 

^2. To determine the kihd and quality of training that is reciuired for 
enlry-lev^J jobs^in the industry. 

*3. ,To revifew curriculum and other materials that are available within 



^the school system &r use 
'Pine Arts and Humanities 



Ln the communications and 'media cluster and in the 



cluster, — • 
4. To develop an oversuLl ^structure through which each program element 
can interact while sharing resources and facilities, 

5t To develop curriculum outlines for each instlructional component 
within the career clusters of communications and media and Fine Arts and 
'Humaji4ties, " 

, Because of the ^eat diversities in the teacher/trainees "perceptions 
of exactly why they were attending tiia conference and precisely how they 
would fit into the total .scheme of the new c^areer center," the ir^itial 
coriference approach to "train tl^ selected group of teachers. to design, 
prepare, sind-vrTite instructional materials to be utilized in the career center," 
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had to be abandoned after the first day and. an alternate approach utij(iz^» 
The Phase I workshop was then so -conducted to "provide a conference 
environment in -which the two ^oups (media and comunicatioiis — fine 
arts and humanities) could ask q^uestion^^^d make recojfimendittions con- 
cerning the center, the programs to be ofi^ed, and how they would iMer- 
relate," As staged by the RCA consultants, an openness concept h^ to 
be establffehed where relevant q^uestions could be asked i^j^arding^ faits 
and proposed instructional make-up of the center, i.e. unravellingj sessions 
after which we were able to proceed with the above (five) stated ob[]ectives," 

Orientati-on for the staff development conference included: 

It Goals of the conference 

2. Role of the RCA Consulting team 

3. Role of the members from thel Division of Career Development Programs, 
Understanding the concept of caijeer Education and how to "convert" . 

in relation to the career centers role in the total process was consider^ 
essential by the consulting team in -order to establish a'workihg ' 
frame-woi^c. A 'simplified 10 siLep mokel was used as basic reference for I 
discussion, with focus on steps leading toi a) the stiidy of' the.currenlj 
educational system to deteiaaine Chaolges needed to convert ^to career education 
b) conduct an inventory and investigate community resources, and c) design 
the preliminary program of career education. There followed aj exercise in 
the review of^ the programs which had ^been Suggested for development and 
implementation in the career cepters. The survey of documents and sources 
of information to identify and 'assess the need for a paarticular pro^Pam was 
begun. These' listings of sources of information would be^ater utilized 
validate the programs to be developed. Additional validation was psl^e 
accomplished by the paxticipants, outside the conference pepi^, in order to 



qeterraine the type suii quaility of education required for entry-level 
obs (from an extensive listing of sources which was agreed upon for the-D.<J,, 
Ijocale). ^ , , , 

The bulk of the remaining period of the cunference was involved in 
dhe third major activity — a review of the renovation plan for the 

National Geographic Building. To again quote the RCA report, "the first, 
visit of the conference participants to the old National Geographic Building 
wjis close to a disaster. There was the first emotional, chaotic reaction 
to seeing ^^he buildings run-down condition, and the' fact that refurbishing 
work h^^Tiot begun. Then there was -the rage and rebellion over assignments, 
of space; namely, the instate tors felt that ill-conceived plans had been matje 
for them, yet when the instructors were'^previously asked to. make suggestions 
regarding the ^building ^ no one had coke forward with the ideas when they were 
needed ^ being solicits." This session culminated in the teacher/trainees 
(instructors) realisiing that they had better cooperate 'a3 a team in order to 
effect the ch^ig6 .of plans which they desired. They worked hard to "swap** 
space, coKpromisQ knd preseiit their refcomuiendations to the architect prior 
to final -biddiag on the renovation contract. The detailed recortmendations 

"ma^e during the conference are shown at Appex>dix C of the RCA Summer f/c^shop 
Report and involved the two clusters of the program plannirlg. * 
Out of these recommendations and the understanding an(J a^eements of 
the^^)revious conf erence-considdlwLtions came the formulation of a tenative 
philosophy statement for the Career Development Centner. Goals were written ^ 
for the Center and program, outlines for each cluster were finalized. The 
complete statement of the RCA recommended Caireer Development Center Philosophy 

* Goals of the Career Development center, ctnd the Programs for each pilot career 
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clJ>ter were -adopted and approved by the Project Director ^d Staff as 
published in Appendix D, RCA Summer Workshop Final Report. The recommeAded 
programs (clusters) outlined the content proposed xor each prograja. It 
was recontmended that the next logical step within jeaLch ptograln would-be 
the "task analysis of each program area in order ti state the content in 
terms of desired student competences. Then, statp-ng of the program content 
in terms of behavioral or performance objectives 

I 

^ Throughout this period, August-December 1973, the contract with 
RCA Service Conpany continued to be changed and/ov modified to reflect 
current changes of actual staff decisions and activities, dates, times and 
those developments. Phase II Staff Development .Conferences, as example, 
were rescheduled form November 5-^1 1973^ and^ December 3-7', 1973 to 
February 25-March 1, 1974.j;id .March 25-29, 1974. The Qontract Article I, 
Statement of Work was changed or modified on three^eparate occasions ~ only 
one of which was formally negotiated as a contractual change, due to "the ^ 
extended dela;^ in-system- of contracting changes being formally effected." ^ 

The modification to cover l^e cotiduct of Fhasp II conferences added the 

I 

•following t<pi the Statement, fof Work: 

! 

a. Direct and establish technique^ "Tor deriving competency standards •^^•^ 
from -program areas utilizing task andaysis. 

b. Review rel^evant oilrricula and' related research materials collected 
by -sch^^^Mb.irersonnel since the Phase I staff and curriculum development 
cionfere^ce (8/20-31/73). \- ' 

Q. Assist in establishing advisory committees and identifying community 
resources as spj^rt for the two clusters. 
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d. Direct and* establish guidelines for developing j)erformance 
objectives, ' 

' e. Develop a recommended format for learning modules for both 
clusters; amd | - . * 

f • Direct wjULting of at least one learning module per program area 
suitable for instr^jStional purposes. 

RCA contract mandays were increased from* 1^ to 30 mandays over the 
two one-week periods. Contract Article II, Reports , added a'final report 
to include at a minimum the followingt 

•a, A listing of the advisory committees for each program. 

b. The guidelines for developing performance objectives. 

c. The recommended format for learning modules. 

d; At least two examples of completed modules developed during Phase II 

' 1 . * 

of the- conference; , \ - * ^ 

e. A staff and management personnel 3elf -assessment,. 
On February 19, 1974/ five days prior to the first of the two one-week 

curriculum and staff development worfcshops (Phase II) , the Project Director 
advised the contractor, Dr,^T. E, Smith, Southwest Regional 6ffice, RCA 
Service Cbmpany of further Article I - Statement of Work modifications, 
tbe P/D letter reference: 

eateries collected by school personnel etc»* hi incorporated as an on-^oing 
abtivity during the workshop period, 

2j, Item d , ^chedule session to inclu(^e instruction and practice 
exercise in developing and writing perforri^ce objectives, 

3. Item e . Provide e:icamples of ie^ing modules -that utiliafe the format 
to be recommended, 

17 
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Item b » That review of relevcipt curri/ula cind related researc 



/ , 

/ 

/ ' ■ , 

' On the 26th of February, 197^ the contract to jotfona the third 
party audit evaluation the project was accepted, ,Tully signed aiyl 
forwarded to Alfred Horin amd Associates. Date/sLnd time as well as many 
activities over the past seven or eight months had already overrun or had 
beei^ out distanced and changed by 4omlno theory /effect. The evaluator was 
able to personailly attend and monitor only one/day's ax^tivity of the 
first one-week Conference in Phase ll due to Ahis late date of contractual 
approval and notification. This then limitai the audit evaluation process 
to a very minimal personal observation and. mandated am after-the-fact 

7 

evaluation dependant alrfost entirely uporv interviews and reviews of avadlable 
reports- and memoranda of the project, , 
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SECTION ll 

A> Major Audit/Evaluation Responsibilities 

The specific audit/evaluation adivities performed by the investigator 

project director focused on the staff training ajid curriculum development 

for the project. As stated in the Overview, the late date of approval 

of the audit/evaluation cpntract^ presented only six days of worfcshop for 

observation and collection of teacher/trainees opinions of the training 

offered. Essentially the training was composed of the Phase I' summer 

woricshop experience (August 20-31, 1973) and the Phase II, two one-week 

workshops (February 25^rch 1, 1974 and March 25-29, 1974). One 

of the first activities. of the audit/evaluation was the attempt to identify 

the training objectives for the teacher/trainees. The objectives were 

originally stated in the D.C. Public School letter of Assurance to the U» S, 

Office of Education, suid in the agreements between the Acting Project i;ira2tor 

and the RCA Service Company representatives. They were later formulated into 

a formal RCA contract signed September ,4, 1973. These objectives were 

modified and changed during the conduct of the first workshop, referred to 

generally as the summer workshop even prior to the formal contract approval. 

In most cases, the objectives, or the actual com{)onents were being developed 

aod thus modified before or^ during the training, gis dictated by the realities 

of the training situations. The modifications were docum^ted, though noV 

fgrmally, as contract revisions and became the guidance for the next training 

workshop to follow. As objectives were modified they' were included in the 

) 

final listings used by the auditor/evaluator, 

1, D^ta Collection. Procedures _ The principle collection devices' used 
for the audit/e valuation task were th^ questionnaire, developed 
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from the training objectives, and the conduct of personal ^interviews 
with staff and teachers/trainees. The questionnaire and structured inter- 
view opinionnaires were designed to cover the understanding and attainment 
of the rtajor objectives of the training. 

'The ^udit/evaluatlon encountered some problems due to the difficulty 
of determining- the statements of objectives and of interpreting their change 
over the period of the audit/evaluation. In some instances, it was almost '"^^ 
impossible to fully understand or interpret the actual intended. outcomes 
of the objectives being used or considered at that particular 
stage of project development. Cor^rect understanding is crucial to any 
evaluatioa effort, particularly ^by an outside evaluator. Todvly stated 
objectives may not accurately portray the intended outcome. This in turn, 
could result in correspondingly inaccurate evaluation of the same objective. 
The evaluator attempted to deal with this problem as diligently as ppssible. 
* Defective objectives should be rewritten prior to the development of 

f . ' ' ' ' 

evaluation instrinnentation ?o the evaluator utilized ,specific component ' . 

objectives as originally stated and verified by, or as modified and 

presented by the individual workshops. ' • " ' 

I • 

Interviews were conducted with the Lemuel A. Penn Center Principal/ 
Director, the Acting Project Director and Staff Coordinators for Staff 
Development and Curriculum. Development. Involved RCA consultants were 
interviewed and obsefVed in their advisory and training roles during two * 
of the three workshop periods.' - 

The questionnaire development process involved the identification of 
objectives and ti\e development of specific items to assess the objectives. 
From the total bctnk of items developed ^ only those Items which most 
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adequately ae^essed a particular pbjective were incorporated into the 
questfonnal/tes. The items, in draft form, were subinitted ,to the Principal^ 
Directpr /for .;;eview and approval prior to administration in final form. 

The que-stionnaire was mailed to the identified workshop participants 
(teacher/ trainees) • This group pf approximately 17 persons will represent 
the "experimental' group", or those who have' received the training in the 
workshops. In-order to assess the impact of the curriculum and staff 
development workshops, a control sample was also identified. The, procedure* 
for the control group sample was the identification of a random sample of 
non-participating teachers from the total population of school districts 
with similar teaching positions, the Principal/Director and'his staff 
participated in the selection of the control group and the saiaple selejcted 
fornevaluation was equal in size to the sample of workshop participanls'. 
The ijimbers in each evaluation sample, for each data collection aire displayed 
in part four of this section and sub-section. 

Data collection was conducted throughout the period by the review, 
pull-copy and file pracedure, \fher? documeritation was limited or non-existant, 
return visits and personal interviews were utilized to obtain the pertinent 
information. * * ' • 

2. Pata Anal ysis Procedures AH dgcuments and materials pertinent to 

w 

the workshops were collected, reviewed and included^ in th^ eraluatioxv^ - • 

I ^ *^ . ' • " ' • 

documentation fil,e, Kajor| objectives, goals and c.hange modifications were 

' . . ' ^ r 

called out for evaluation and f iinal assessment to iDe included in the evaluative 

conclusions,. The Summer 1^/orkshop analysis of dat^l^s necessarily limited to 
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the RCA Final Report on, the Summer Wdrkshop because the contractor • 
provided no otKer materials or aids as used in the training (other than 
that he commented upon amd/or attached as appendix to the RCA report). ♦ 

Training materials were provided for the vtcwo^one-week workshops 
held in early 1974 (Phase II) suid review suid suialysis as to their content 
and pertinence to the stated draining objectives was accomplished. This 
audit/evaluation was based upon review' and the observed use of materials in 
the training situation, It was compiled with our judgemfental evaluation 
and the stated opinions and evaluation of the teacher/trainees involved. 
In addition, the Acting Project Director, Principal/Director, Staff 
Coordinator of Staff Development and the Curriculum Development cpordinator 
were all requested to provide internal evaluative memoranda in order to 
increase the breadth of the data colle/ption and the atnalytical procedure 
^ of the investigation. 

Procedure for the SLnalysis of opinionnaires^ follows th^ structured 
questions base with quantified \^esponses placed on a multiple response 
format (which also includes a narrative summ^xy). Analysis involves the 
interpretation of recorded responses, allocation of quantification or 
^ i^^dicated level of import within response, and the completion of a'siymnaxy 

evaluation and written summary statement. The data from the questionnaires 
^ .was collate and analyzed when the questionnaires were returned. The 
^ analysis procedure was es follows j 

, a, tabulation of the. number emd percentage of questionnaires .-weturned. 

* " tabulation *of the -Humbei? of resporfeeS" tfor, eacl) alt^rnatevrespfihs^ 
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for each item, smd the number of non-responses for each item 
c, tabulation of the percentage for tasks b. 
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i * 

d\i tabulation of the number aJid percentage of responses to each 

alternative for, each itea across .components vfithin the jprogram where the 

f 

items, and therefore the objectives on which the i;tems are based, are 
common to the two or more component^ within the program* 

e» tabulation of the number suid percentage of responses to each 
alternative for each item across experimental group component atnd control 
group cigjponent when ^the items, and therefore the objectives on which t\ie 
items are based, are cpmmon to the two grpups, 

if* 

f . ^presentation of 'information ^ ' • 

1) tabular fgjrmat 

2) graphic format (where appropriate) 
3} narrative summary format , » 

is used -to provide for explication and interpretation of the data and 
of the data collect i<Jn and auialysis procedures, . « . 

Procedures ^^or the amalysis of the questionnaires, both experimental 
group and ccJntrol group, consists of tabulation of *the responses identified 
by the sample group and analysis of any additional components. This analysis 
was limited to a summary tof the major points presented and a statement 
of tE?m positive or negative tone. A chi-square analysis was ^(5 1 attempted 
nor was ^correlation coefficient developed relative fo the interpretation of 

information between the .two responding groups due to thetr small 'size and 

I 

lack of realistic numerical frequencies, . *^ * * 



3. |Datk Interpretation Procedure — Records, memoranda .and. reports 

were reviewed and interpretation based upon verified statements of Project 
I *. » . • . ' 

Administraiive Staff or the RCA Consultant ^taff . Judgmental and opinion 
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statement was collected relative to the degree of accomplishment of ' 

- ^ 
process objectives from individuals being- trained as well aLs the project 

staff providing assistance in the t2>aining program. In the interpretation 

of the Questionnaire instrument we identified. the responses to the ini4jial 

structured interviews for those persons who sdso completed the (^ue^tiorma^e , 

1 ' ' 

instrument. This information assisted in the interpretation of the/^ ^ 

{ \ 

questionnaire data for the experimented group, ^since the opinionnalr^ 
^ ' responses of those persons who did not complete the opinionnaire but did 
complete the questionnaire ma^^ be different/ The similarity or difference 
of responses could not be determined or interpreted without the use of 'a 
procedure such as the interview and opinionnaire. There was Insufficient 
time and money to provide the follow-up interview to identify a reason or 
reasons why the non-respondents bailed to complete the questionnaire. It 
was recognized that siaq:h a follow-up interview would have been of consider^ 
able value to the ov-erall interpretation of the evaluation process. 

The examination made of the project records was for the purpose of 
. determining the degree to which the proc^ks^objectives were being met as 
stated by the staiff in official records. It was also felt necessary to 
identify and clairify ,the .exact change requirements and ^ftbdif icatl^oaa^of ^ 

objectives which were «ncountered«^ver this initial period of tRe 'project, 

* 

The tesults of the data collection process atnd correlation of responses 
to questionnaire alternatives have identified the skills, knowledges, and 
attitudes of the persons randomly selected for the control group .component 
smd who might have been selected for the curriculum auid Ststff Development , 
training. The assumption was made that these* teachers did not appreciably 
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differ from the teachers who wer6 selected fo?r training and teachiug , 
in the center, ,This random selected group thus became^ the experimental, 
group component. An inteiTpretive comparison of skills, knowledges. and 
attitudes of these teachers with the skill, knowledges, and attitudes of* 
teachers who received the training prqvides an indication of the changes 

r ' 
I 

Which have occurred as a result of participation in thie* training program, 

Vfhile all other factors have n^t been held constant, axi assumption 
was made that some of the differences between th^^control group component 
(non-selected teachers) suid the experimental group component (teachers 
selected for training) is the result of the curriculum and s tbJTf d evelppment 
training^ Th^ inteirprfetive task^ was designed to utilize data reporting 
procedures to identify differences between the two groups of teacher^. 
Data Presentation ' ' - ^ 

a, A structured interview format was constucted to follow-up on 

process objjactives. Component A teacher/trainees were interviewed and 

responses summarized by the audit or/evaluator. The structured interview 

> 

instrument was designed to (5,uery and directly review the status of progress ' 
toward accomplishment of the identified objectives for each training, \ 
management and staff development comjxonent of the project. The opinionriaire 
wa6 accomplished during the three-day period of the workshop March 26-28, 
197^t Presented here is the data instrument (format) used in the Analysis 
of the Opinionnaire, 

TABLE 1 - OPINION SUKVEY; Personal Interviews of Teacher/Trainees ^ 
on page 23. ) - . 

TABLE 2 - OPINION^lftuUTION on pages ^24-25, 

Analysis of Nummary Remarks found on Table 9, pa^e59. 



b. The auditor/evaluato? developed a, questionnaire format con- 
sisting of items dealing with or identifying both process and product 
objectives of ^ the project^ The questionnaire cwsisted of items or 
questions with a series of alternative responses identified. Respondents 
were chosen from two mail-out listings; Component A r- the program teacher/ / 
tifainees arid Component B — .the randomly selected group of Vocational 
Education smd Industrial Arts teachers from other schools in the system. 
The instrument's are displayed at App, #1 and A]^, #2 in Secti6n IV of this 
report. Respondents were a^ed to identify one of the alteimatives 
supplied and st^ace was provided for the inclusion of additional comments, 
by the respondents. The analysis of additional cpmments was limited to 
their presentation in summary form and a stat'ement of indication of their 
positive or negative tone. After tabulating the correlating responses, an 
analysis was conduct^ on each comporvent, , 
TABLE 3 - Data Analysis-;Questionnaire 
'/ Program Respondent-Component *A > on page 26 ^ , 

TABLE k - Questionnaire: ''Respondent A , • , 

* ' • /' , 

*• 

Tabulation on pages 27-31 
TABLE 5 ^ Data Analysis-Questionnaire , ^ . ^ 

Control Respondent-Component' B» on 'page 32 ^ 
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TABLE 6 - Questionnaire; Respondent B » - 

Tabulation on ^ages 33-37 , 
Responses from, the selected control group, Component B wero then 
corr>elated to those of the Component A responses with questions/responses 

i - • ' 

cod^ as indicated, ■ \ 

' TABLE 7 - Cbde^of Correlated QuestiQns,( on page 38 > . 

■ \ ' ■ ■ 26 




A cbi-square analysis was riot conducted on the control* grorup findings 

nor yas a compar^llity analysis undertaken due to the smail numbers of 

respondents* Analysis oi| data undert'^wln between Coraponent A andComponeut 

B using the coding provisions, a^tabll^hed earlier to compare responses Qi the 

'two components. * • \ ' * ^ 

# *• 

TABLE 8 -Data Analysis-Comparability of Responses 
" ♦ ' Compx>ft0at_A: Component B 

Tabulation by items on pages 39-45 • ^ 
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lABLE 1 ~ opinio:; SUriVEY 



Personal Interviews of 
Teacher/Traioeps 



1. 



2. 



3- 



6. 
7. 

8, 



10, 



Have copy and understand stated objectives of Career Development 
Project? ' • \ 

Were you "selected" for tht^ teacher/curriculum development position 
or did you volunteer servicei^? 

ifhat are the (teache^r) stcLff development objectives of the workshop 
training (staff development) as you ujiderstand it? 
Have you attended all sessions of .the 'RCA Workshops? 

a. Summer (j^ugust 1973) ^ 

b. Winter (February 25 - March 1, 1974) ^ \ 

c. Spring (March '25-29, 197^) 

^o you have an^jstrpng feelings' of^/rustration or inadequacy with the 
Workshop andy^r Teaching Technique? 

What curriculum development area are you participating in? 

Dd you feel the workshop and handout material!^ !are helpful?* Rate 

1 r 5^ (high). • ^ : ' • ' 

Are you working with a committee or on your'oviP in curriculum 

/ • 

development? r ' 

Have you developed a "curriculum outline ^ yet? (convert to , 
Competencies amd' Learning Packages) 

Feels /competent to write curriculum? (learning modules) 
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TABLE 3 



Data Analysis '-^Questionnaire 

« 

Progxam Respondent-ColsDOnent A 

^uestioniiairfes mailed out - 9 
Questionnaires returned - 4 

Number of responses for each alternate response by iach item: 

^Item #1 - Don't know, etc., see page 29 of tabulation of TABLE 

Number of non responses for each alternate response by each itto: 
Item #2 - Develop cluster programs 

1 (2^1) 

Iteta #11 - Career Development Center 

Philosophy & Gcjals D, C. Schools 

Percentage for each response or non response eaon item: 
Seepage 29 of tabulation of TABLE 4. 
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TABLE 5 > 

Data Analysis - Questionnaire . 

Cpntrol Respondent-Component B- 

i 



9 

♦.Questionnaires mailed out - 11 

♦ Questionnaire returned - 5 (^^S^) 



♦ Number of responses for each alt^mat'e response by leach item: 



Item #1 - Hon' 



p knovr, etc,% se^ page 35 of tabulation of TA3LE 6, 



♦ Number of non-rresponses for each alternate response by each item: 
Item #5 Prepare' instructional modules / • 

, " 1 (20%) • 

Iteui #22 - Voc, Ed, Pregrams S Oytlines 

, . 1 (20^) 



♦ Percentage for each response or non 'response each item: 
See page 35 of tabulation of TABLE 6. ^ 
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Code of CSr3::^lated Questions 



(to) 

X . 
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Com-ponent. B 
• 1 

i 

i 



5 
6 

, 7 
8 

9 
10 
10 

13' 
1^ 

15 
16 

17 
18 

19 
20 
21 
22 



A. 



r 



KOTiCj/ (see corarcents) |.| 
Infei/ential k 
relationship: 

(11/12) 



Z\ (11/12/22) 
25 
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Data Analysis ^ Comparability of Responses 
Coraponent A t Comporyent B 



Item' ^ - All respondents agreed tha't career education in the secondary 
schools was important for vocational choice, 

VlOO/t 5/100% 




r 



r 



Item ^2 - Cjfie respondent in Component A had -not participated in the 

ment of the^content outline for cluster programs of the career program axeis, 

M ' ^ ^ ^ J* . 

Two (JO?) h^developed only one content outline while one {2%) had developed 

three content outlines. One respondent in Compoftent B had developed only 
one (205^) content outline for Voc. Ed, programs, while four (SOjg) had 
accomplished two cjorriculum outlines, 

X *• • ®1 Prograia/50^ @e Prqgran/80>5 ^ ] ' 

\^ Item - All lpO% of the Q)raponent. A respondents agreed that? the cluster 



-J«^g3?a»s would neet individual student n^s-ba:sed on statement of student 
learning desired ^and -performance objectives, ,Only one (20^) of the 
component^ respondents ^disagreed with the statement that the Voc, Bd, pro- • 
grams meet •the individual student needa, 

r 

Ite?. - All of the toraponent A respondents agreed that sufficient time 
U(as spent in developing tfie program clusters, ' One (20^)"<bii^onent B 
.respondents dJ.d not know whether' Sufficient tine haH been spent in the develop- 
ment of Voc.. Ed^ -program curricula, Two'(^;5)\ndicated tljat tliere was' not 
sufficient time spent in .the development of curricula, while two agreed 
thi&t the tine spent on curriculum' development of Voc. Ed. programs was sufficient. 




ERIC 



44 



39 



\ 



TABLE 
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Component A: Component B (Continued) 



page 2 'of 7 



Item #5 -^Two (50^) of; the Comi)onent A respondents had prepa2|ei.^t least 
one instruction^ module, while two (50%) had\ prepared more Ijhan six. 
One (20%) of the Component B respondents did nW respond to this item, no 
comment or reason for non-response indicated, ofte (20^) had prepared at 
least one instructional learning packSige and. two- {^%) had prepared at 
least two such packages. ^ 

2/50^ , . 2/40:^ ^ * • 

Iten^ ^ " All of the Copiponent A respondents agreed- that thei:* workshop 
activities and exercises had been useful in other lns{jruct^om I areas and 
by degree, split two4^'^) as "a little useful" and two (50^) 'as "quite a 
bit". Four , (80:?^ of the Componpnt B respondents indicated that^^rmal 
workshops and prepared exercise^ had been "quite a bit" useful to ih^ 



aoreas. 



\ 4 



in other Voc, Ed, instructional 

'2/50^ 

Item #7 - One (25*5) Comj^onent A respondent understood the performance 
objective statement to communicate only "what the student will do" while 
th^'ee (75^?) correctly indicated an understanding: "to communicate-^ifhg^ 
student will do, circumstances of performance auid, degree of accuracy," 
Three {6o%) the Component 3 respondents correctly indicated understanding 
oT^what the performance objective statement tells us, 

3/75^ 3/60^ 

Item ^8 - Ap.1 (100%) of the Component A respondents indicated that team 

I 

♦ t 

planning and grouping by progran clusters' and experience Kas in itself a 



/ ' 
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valuable experience. Pour (80%) of the component B respondents .^dicated 
that such g:youping was a vaj^uable exp^ience in the.Vpc, Ed. system. 

Item ^ - Three (75^5) of the Component A respondents agreed that team- 
work was a more productive method of accomplishing the Career Development 
Center goals. ?our*(8o;S) of the Component B respondents agreed that team- 
work in Voc. Sd. and career programs was the mo»e productive method of 
atcomplishing educational goals. 

Item #10 - All (100^) of the Component A respondents cigreed that the 

Leuwell A. Penn Center had purposeful, established prpgram goals. Only i 

two {kOfo) of the CoiRponent B respondents agi^eed that the established .Voc. 

* * 

'Ed. goals are publ^.shed and used, j ^ 

Jtejn ^1 " Only ^one (25.^) of the Compone^ A respondents agreed that the 
published philosophy and goal statement for the Career Development Center . 
had a'^speciflc statement of seven program goals. Three (7^%) did not 
respofftl to this item, .with tio indication for 'reason of non-response. Three 
(60^)^ of the Component B respondents felt there were no published goals .for 
the Voc. 3d. program or that they were not. used by the ' instructional branch 
or program teachers while two {itO%) used the published goals.' 

1/2$^ . ' - 2/4o^ 

Item 412 - tlxreV (75'?) of the Component A respondents agreed that part of 
the philosophy and proposed operation of the Career Center was to share 

• • ' ■ • . ; \ ■ ■ / 
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domAon resources. Three (60,-3) of »the Component B respondents agr<jed| 




1 I 



that related Voc, 3d, programs in the area schools novj Share resoi^Cjes, 
Two (^t) indicated they "didn't know," 

' Item #13 - All. (100,"?) of both Component A and respondents agreed that 
interviewing workers provides job knowledge auid satisfactions which the 
teacher can communicate. 

VlOO^ , 5/100^ 

Item #1^ - Two (50^)^ of the Component A respondents agreed that the concept 
of career education should involve preparation for "personal fulfillment," 
Three (60^^)* of the Componerft B respondents agreed that the concept should 
involve preparation for "appreciation for the dignity^ of work.'* While each 
sample component had respondents who selected "Noae" as the response, there* 
was also no consistency in the other responses.' Two (4o;^ of the component 
B respondents marked three of the four possible response ^t<miatives thus 
indicated' a lack of knowledge of the trend and effort to <|areerS^cate 
•to the world of work. . 

(c) 0/05S (c) 3/6o;g \ ^ 

Item .^15 - Two (50,^) of the Component A respondents felt thaj career 
education was concerned with '"givipg new structure to the curriculum" while 
one (25?5) felt that the concern was "preserving what is good in career 
preparation" and only one rightly indicated "the understanding and 

relating mcin with the world of work". Four (80^) of the Component b\ 
respondents agreed that^-oaiieer education is concerned with "understanding 
and relating man with the world iff work". 



1/25^' 
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Item ^6 - All (loot) of the Component A respondents ag3^e$d that as^ 



x\esult of the workshops suid 5)re56ntations, they felt more comfortable 

In dealing with CS ins^tructional needs. Similarly, four (80^) cjf the 

Component B respondents felt ,that as a result of formal educatich and 

ft* 

workshops' that they were comfortable with the needs of their Voc. id. 
instruction. One (20%) indicated uneasiness in the dealing with t^e 
needs of Voc. Sd. a result of formal training atnd/or workshops. 

4/lOO=J, V8C^ ' I 

Item ^17 ^ All (100^) of the Component A and B respondents agreed' that 
program developed performance objeqtives represent a rea^onatle mix of 
the three le£iming domains. 

VlOO>S 5/100-^ ' » 

I • 

Item ^8 - Two {50%) of the Component A respondents rated developed 
performance objectives as average, .while only one (25^) rated the objectives 
overall as excellent. Two (^K)^) of the Component B respondents^^ted 
^ developedy performance objectives as exceller|t while three (60%) ratedr 
them as average. y ^ . ^ ' \ 



i 

1/25% , \ 



Item ^9 - Two '(50^) of t;he Component A respondents agreed that an 
appropriate and adeq^uate evaluative process was identified'^for evaluation 
of student performance on each perfobnnance objective. Two (30%) indicated 
that they "didnt know". Three (60^) of the Component B respondents agreed 
that there was am appropriate and adequate, evaluation p3«>cess identified,\ 
while two i^.t) were indicating that they did not agree that the evaluative 
process was proper or th^t they -^'didn't know". 

* 2/50^ 3/60?t 
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IteQ fZO - *Three (75^) of the Component A respbndents rated t^ 



studfent evaluative process •'average". Four 



respondents similaorly ^ratec 
one respondent in each of 



(8(^) of the component B 



the overall eva^.uation as "average". Only 




he components ra^ed the overall evaluation- 
pr<>cess as "excellent^. Tpere were Aone who rated it Vpoor"/ 



Item #21 - Two (50^) of 4he Component A respondents had helped prepare only 
onfe cluster pros^ram and p.ts progrc^/dutlines. Two (50>S) had helped prepare 
nine or more programs and outlines between them. Three (60^) of the 
Component B respondents had helped prepare only one Voc. Ed. progreim and 



program outlines. One (20t) had prepared two programs and outlines, while 



one (ZO^o) failed to respond to this item, giving no reas6n for lack of 



response, 



1 



Item 4^22 - Three (75??) of the C orapbnent A respondei^ts found the ''RCA hand- 
out exercises ani difecussion io be "helpful". Only one (2^) respondent 

* 

with a*high scalie radrkinc of --"most helpful". , 'None rated them low scale 

some help" <r "of no help". When (^pared vith item response to 
Component B iter s #11 and<?12 on learning \ctivities, two (40^) respondents 
agreed that theit Voa. 3i. learning provides properly seq^uenced materials 
(itemVll) and fd\jx (80f5) indicated that their individualized learning 
activities are multi-m;edia. (item #12). NOTilt In this comparison the 
Component A situation refers to staff training exercises while the » 
Component B situations are -^reporting learning activities provided the 
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student Voc. Ed. teachers seemed uncertain or indicated "no** {(^0%) * * """^ 
regarding properly sequenced materials ♦ 

^/lOO% 4/80^ 
[ item - Three/ (75^) of the Compdifent A respondents rated the RCA 
workshop and overall module development prt^gram as "avezrage". One (25^) 
irated overall- ajs "excellent". Two (^^c) of the Coiapon^snt B resBondentjS 

Licated tViey^had "formal education" in ihe development of leafning 
modules. Two (^t) indicated they had hid 'Workshop-staff traj^r^ng". 
One {2(H) indicated training to 'include "jpre-doctoral study", 

^/lOOfo 5/lOOfo 
Item #24 - Three {75%) of the Component A respondents indicated they were 
afforded assistsmce of an advisory committee. One (25^) indicated he 
"didn't know". Three {60%) of 'the Component B respondents indicated they 
had not been aXforded such assistance and counsel for their V>2 

instructional program area. Two {^^) indicated "yes" and t 

t 

received such atssistance, / ^ / ^ * 

.4 — ^ ' . ^ • 

3/P5?5 ! s2/40^, , • • 

Item .4^25 - Three (75^) of the Component X respond,' 

• ^ \ , ^ ^ 
examples used in tne workshop provided th^m with 

formats". One (25^) resp<inded that the •examples, provided him with "insight 

into Witing of the program modules and format". Three (60,"^) of the Component- 

B resj)ondents rated the Voc, Ed, pro-ams use of standard format for learning 

modules as "average" with one written comment submitted staging "need supplies 

and je^uipment^ to cairry out th6 career educational pro^tam; These we lackl" 

One (20.1) saiil that he considered the use of standard formats "poor", 

3/75.^ 3/60^ 
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ints agreed i^hat the 

•a cross section of several 
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5. Evaluative Conclusions 



In tlje rehruary 26, 1973 letter of assurance to the Associate ^ * 
Commissioner of Education, U. S". Office of Sducation, the first prodiic^^. 
objective S^statement of this resecirclj suid development project was stated 
as "intent tp establish two interrelated pilot ceireer clusters of career 
/^development pr6grams in the eireas of communications^ and media; f,ine arts and. 
humanitiesi We find that the building site for this prdject, the former 
National Geographic Building has in fact ^been renovated knd designated 
as the ^emuel A. Penn Center. It is located at 1,709 3rd Street, NW in 
Washington, D. 2. ^nd although plagued with many Contractual delays appeareS 
to be ready to accept its first stud^nts, Lith the| advent of the 1974-75 
school terms. ' ' 

The second product objective stated lor this prc^ject was that this 
R&D project "would,^ provide planning and evaluative capabilities for 
implementation of a high school level career development program designed * " 
to provide job preparation in communications and media— fine eirti and 
humanities," We f^nd that overall the -approach and planning for ^his 
project maV have been too extensive to have been accomplished within the 
very strict time table presented initially. Delays in obtaining the initial 
grant approval; bureaucratic policy and procedure, within the administration; 
contracting delays Ho process smd effect projectj eupport all led to serioui 
delay. OnlA persistance on the part of the Actii}g| Director and the agreement 
of the consultants to ''proceed without firm eontraWl^providjed services to 
undertake Ijjhe preliminary steps toWard curriculum and otaff I>evelopment. 
The contract^ for innovation of the biAlding wer^ slow in prepaaration, 
advertising /and award, /ftctu^ work, once started, fell behind time-schedule, 
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materials and wrk were both delays and the target of occupancey. by 

1973-7^ school year fell by the wayside and was retargeted for the 197^ 

75 school year. The Acting Directors persistance and the initial work 

of the RCA^consultants picked up what had* been planned as, a "six-week 

workshop to be held during the summer of 1973 #" after reprogramming 

conducted three workshop meetings over the period of time from August 

1973 through Viaxch 197^. Some teachers were not available for ,the August 

* / 

1973 workshop due to the late notice, summer work, or illness. By conducting 
the.reprogrammed training during the school year, not all^e designated 
teachers could be re^Uased from instructional duties irj order to share ^in 
in-4ervice currlculum^^ staff development |^ining, F*^r pdScposes of 
continuity*". it becaune napessetry to prog^m selecte^ teac^er$ for the^ 
training and ask thalxtney then return to their faculty ^Counterparts to 
discuss their leaiming *expetience|k and shetre worksht>p matWiaTs, The 
"intensive period of traini;ng and curriculuim plajihin^' was alsoxrevisjed . 
and offered over a greatly extended! period of tjime With some loss of I J 

I 

eontipuity. 



.The nucleus of staff 'Jersons,! including the principal to be assigned 



to the career center, were to also|eng2ige in this intensive peribd of 

^ ^ ■ ' \ 

training ^d curriculum development. Another delay to progran expediency 

was the fact that the Principal/Director was not available and/or assigned 

to his very important position of leaderafiip and program continuity until 

November 1973. \ - ' . ^ 

'The concept of operation entails the release ,bf students from otl)er 

'I 

**fe€tder" High Schools, where they will be involved. in academic studies 
to the Cfioreer ^Center where they will pursue 'career Jpb training. This 
Career Center, arid, others i^follpw in the D. C. Schools master .plan, 

• 52 "■ 
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wi).i provide students a choice of vbcation^J. training courses within 
their "strong interest and job aspirations". The Career' Center courses, 
'ajjd conseq.ueritly. the thrust of the D, ,C, Schools Vocatiojial ,Educa^ioji, will 
te directly related to '^thfe 'bntiy level" jol? skillfe and ^he realization 
that more aLnd^mpre youngsters are opting to go to work, and to get 
Involved with "blue collar" jobs which often pay more than the "whiteyj:ollar" 
jpbs av^lable to the college graduate. The Department of Labor now 
pof edicts "that t^ree o^t of foiur-new jobs between now and the end of the 
decade will not reqy({re a'^poll^ego-education^ " By creating the Lemuel A» 
Penn Center, the d. C. Schools are gffeatly expanding the list of Vocational 
training courses to help meet this growing, dematnd. It is also iioted that 
another expansion has recently been implemented to coriveirt Western High 
N School iiito^ city-wide sphool' (celiter) f or jthe pei^^rming arts' in such/ . 
j^61ds ihea\er, .music, dsuice anc. film m^^ing. Suc^i expansion of ca^e^r 
and job training capabililiies will allow B. C, High School student 
4^0 exercise ^ muph brodder option regarding listings w]ien making career and 
job trainllng selection, \ The (work objectivles of. ihe curriculum a^d staff 
development training and i^onsultant services to be ^provided by the HCA 
Service Company nWe modCifiedj and changed by contract amendment to add . 
additional services to be cgmpleted .irt executing Pha^e II (Spring 74| of the 
training. After Phase I objectives (Sjimmer 73) we foilmd tl?at th^ in^trtimer^ts 
'of Vommunication of the sta^-us of praj^t.ldevelopmentj^ space allocation; 



program and curriculm <>ff erings proposed; review of relevant materiad^ 
anci review of the proposed jplans for renovation had in many instajices \^ 
not ^rrivedat the teacher level or had. not been communicated at air until ^ 
the Phase I workshop was accomplished. As a result^ in addition to.the^ 
combining of the individual efforts and e^t:ablishment of a team effort 

■ , • ' ■ • A8 . > 



among the. teacher-trainees, there evolved a new experie»ce on the part of \ ^ 

• ' *^ ^ - ^ ' . * * /' 

the trainee when facing program expectancies smcl.the "re^ world" of 

• • * ^ %* * ' • 

development of ti\e Career Center and the curridulum. There 'existed a- 

nee^ for th6 participating {nstActor$ to review relevsuit materials and 

discuss the proposed programs With tnowl'&igeabl^e personnel in the various^, 

fields "according to the RCA Final Report, of Phase I training, " . Additionally 



as ^ stated, 



the affected instructors needed. to tour, the center and review 



the proposed pls^s for remivation,". These basic *needs had not been satisfied 

prior to the Workshop.. Accordingly,* after a limit^,period of concentration 

on ^he -review of suggested proglrams "to Identify and determiHeHhe need for 
» * ' ' ^ *' * ' 

a particular progrgtm" and "to determine the typfe kad quality oif education 
required for entryrlevel jobs", extfensivie review of sources of , information 

, , ' . • ^ ^ j - v • 

outslc^e the workshop^ becam^nec^ssary. These sources of inf orm^'fiij.on were 



qu^^ ^xtensive and due to their limitation 



"could not be pursued auting 



the * workshop but hadp not been well coordinated fjor ^a^yawe preparat^n * 
prior to the workshop eitheri'r 
? The -majority of the followlhg worfcshop periods, approximatelj^. bne j,^ 
week, wafe devoted to making recprnmend/ationk for-,change and/or'^ re-alloca^ion 
of planned inilLlding utilization. These activities resulted in ^.complete* 
.set of recommendations being presented to the architect prior to ^inal 
bidding on the renovation, they al^so consumed much of the workshop .time 
programmed for development of the philosophy^ and goals for the center as well 
as the finalization .of program outlines (curriculum .outlines as stated in 
the RCA^on-Lract) for each instructional component within the two career 
clusters, "^^^ • * ^ \ 

Many of the teacher- trainees; stated. that the^ philosophy statenpit 
as well as the ^pals and course* development as pr^sent^ in the RCA final 
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report (App. D) Were not in fact .made available to them u/itil' 'sorae€ijne 



during the later Phase II (Spring 74) workshops. Th^ Phase I conference 
(workshop) irf August '73 was not necessarily conducted as origiijally designed. 
This is not to say it was found not to be successful or valuable to. the 
growth and product capabilities of. the staff and teacher/ trainees. It - ; 
was, however, a very frustrating, time for ihe teachers amii a time 'of constant 
flux and program ad justftien^ by the RCA consultants, ' However in their 
own ^words, ''this conference was custom-tailored, ^eind the flexibility am 
adjustments provided led to its perceived success," ' 

* - - 1 • ' • l I" 

All of the major listed produdt objectives were accQmplished tn part 
or in their en^ore^y with the exception of the Establishment oi th^ 
advij^ory com^jttees for each cluster! program area,. This job of estiblishing 
the various acfvisory conuaittees was ^dressed by RCA "^eams as a recc^endation 
"to be 'festablj^hed in afl areas withi^ each cluster", \ Their final report 
recognizes thaf "the^^aSsea of printing was well supported by its advisory 
committee; however, in other a^jeap within the same cluster there wcis* little 
6r no visible support," The clufter programs were developed in rough foxrm 

' * ' \ 

during the Augiist ZJr^ workshop^and followed by after RCA team consultants 
an opportunity to review and further d-evelop the content outlines. 



iditional staff and HCA consultant activite^, were accomp 



iPllsiW 



as late 



^ as October •73tf> finalize the propossed' clUster programs. The cluster 
f programs presented in the RCA Summer Workshop filial rey^is:^. (App, D) 



establisheo^K^roposed outline of content for eich program. This oatline 
was not immediately and readJLly available to the teacher/trainees ^invo^lved 
in the program. The RCA te^ proposed that th^ "nfext logical step within 
each progTcim is to task anal^e each program area ind state the content 
.in ter5fis of. de&ired student tom^'tenci^s to be followed by writing action 



50 



^ which "logically leads to stcy^ing the program content in terms of 
behavioral or performance objectives." The RCA team thus establisl^ed 
the ^S3^^ j^rameters for tJ^FlTlrst Phase II wor)f&hop, originally sche<luled 
fbr^iovember\nd Decembe^l973 slipped until P'ebruary and March 19^4. 

The previousl^-pfop^s^ed pilot jcareer cJluster programs thus gave 
away"" to the newly approvel (after Final Report acceptance in January 197^) 
cluster programs first published or Appendix D PILOT CLUSTER PROGRAI'lS 
December 26, 197^3 » completing the product objectives of Phase I,^ curriculum 
and staff development. The program outlines within tKe fine etrts and 



hunanities cluster focused primarily on the fine arts as opposed to the 
humanities ajid was stated in thelriijal repoi:t "not complete". Fine srts 



and , hi^anities did not^Jiave a full representation ot instructors and the 
proposed program for musd^ wais not. complete. 



Negotiated contract services req^uested for a change to establish 
Phase II cjssistance' and services by RCA Service Company on September 20, . 
1973» Intint was slated to provide continuation of a curricul^um ani staff 

■ \ ll- ■ • 

levelopmenv. project (PJjase l) and 'was tenatively scheduled f^r rWvember 
5-9^, 1973 am December 3-7, 1973. The specific objectives of such required 
>sistahce- was" as follows: ' ' ^ - 

A. l Direct- and .establish- techniques for' deriving competency stan4axds 
:om prd^ram areas utilizing tasJi: analysis. ^- 

B. iReview'relevsmt curricula and relat|d research materials collected 
by\ school, personnel ^ince th§ Phase *>! st^f and curriculum development 

^coilfetence (8/20-31/73). . ^ * 

. \ / ' 

J. Assist in establishing- advisory committees and identifying 
comnUnity resources as support for the two clusters. 
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D. Direct and establish guidelines for developing performance 
objectives^ 

E. Develop a r^conuaended , format for learning modules for bpth 
clusters. • 

F. Diract* writing of at least one learning module per program area 
suitable for instructional purposes, * 

After consideration .by, RCA peirsonnel ^nd a ^JlanniAg session for the 

workshop theft scheduled fo^ February 25 through Kcirdh 1, 197^ » the 

Acting Project Director issued letter instructions to the RPA consultant . 

team dated February 19, 197^, making the following additional recommqjhded 

changes in the Statement of Worf: ^d contractual objectives i 

. ^ ref , abovfe Item 3 . That review of relevant curricula and!^ related 

materials collected by school personnel, etc ^ be incorporated as an 

on-going activity during the WQ3±ahop period, 

Itecy D . Schedule sess^^ons to include instruction and practice 

/ \ ^ .\ ^ ' ^ 

exercises 'in developiAg and writing •performance objectives. 

Item E ,. Provid^-^amples of learning tfodules that utilizes ^he 

format to be rec<^mmended, * * ' ^ . / 

Based upon workshop (conference) obsei^^at^on by the .Auditor/cMaluator, 

* * \ 

Phase II of the curriculum and Staff DeveloJ)ment scheduled activities 

functioned more smoothly than that of the previous phase. Daily conference 

schedules_were prepared and discussed with the trainefes. Scheduled activities 

w^re 3^ather broadly programmed in order that some flexibility would prevail * 

• anl the RCA teasti provided Ipgicail and practical progression fjfom one day^ ^ 

• jV ' ' L * 

wbrk to the next in accoraplishmett of* the training and/ curricUlum development 

Actives,. As ex^ple, for the toeriid Ji^ay, iFebructry 26 tLrOugh Frida^, | 
Harjch 1, 197^, itie following .jagenc^a w^ pre^ent€d to includey han^-out materials,| 
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practice exercises in those staff development areas called out by the 
contract amendments and' letter of recommendations previously refered to: 
Monday. 2/25 - 1-Introduction of Conference Personnel: Washington, D, C, 
Staff; RCA Staff 2-Introduction to curriculum process: Review of Phase I 
Staff Development; Management Plain for Program Development; A hodel for 
Developing Instructional Materials; Individualized, Continuous-Progress 
Leaimlng Systems; and Competency-Based Learning Materials, 
Tuesday, 2/26 - Deriving Learning Competencies; Behavioral Analysis 
-How to Identify Competencies 
-How to Use Task Analysis to Derive Competencies 

rfednesday and Thursday ^ 2/27-28 - Deriving Competency Statements for 

V 

^ Pilot Progr^s . ' C 

Thursday and Friday. 2/28-3/1 Writing Behavioral Objectives: Behavioral 
Objectives Defined; Components of Behavioral Objectives; Writing an 
Acceptable' Objectives; Classifying Written Objectives, 

In general, the training conducted was quite satisfactory even though 
accomplished under rather poor and ^distracting conditions. The teacher/ 
trainee Attendance was well below average (^^-50^"^) • The stated objectives 
of 15 teatfher/trainees programmed, Additidnally , the working space and 
seating §trtangement was rated very poor. Trainees were required to be 
seated in primary and elementary grade size student chairs and at centrauLly 
facing small\ tables. To 66mplicate the insljructional progress, w^re the 
conference l^euier required attention- at the jfTont of the room, ^0% of his 
audience was involved in a chair shuffling ''turn-airound". These distractions, 
when coupled wi^ the fact thlt there were many trainee amd dther instructor 
cpnverafations being caf5>ied on at the same time, were detrimental to the 
understanding and learning process. Personal arguments between trainees not 
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oVly disrupted that groups pragTi^ss in^ the wofk accoinplj^^hed but had a 

,direct effect upon the entire workshop, ' , , . 

It wcis apparent that the trainees were offered a deeper insight . . 

into curriculun development and the whole prdblem of competency-based ' 

instruction than that previously available to them. As ifidividuals, 

the acceptance amd thus "use rate" for the new knowledge would vary 

/ • • • • 

greatly within this small group. Prepared*, material^ and procedures 
presented and acceDted, will definitely provide a great deal of . , 

standardization. ' . . [ 

One of the chief concerns of the Principal/Director was the fact ' • 

^. ' • . i . 

that not all hi^ ^teacher/ttfainees coqld attend the wirk^hops, Kis concern 

related to expedience lost to the inability to participate in the workshop 
» 

and the need to pass on,' thus absorb, the established staff standardization. 

.The conference sch^ule for the^ following period, Kaxch 25- 
29, 197^ completed the Phase II training: 

Monday^ 3/25 — Introduction of Cci^f^ence JE*er$onnel: Washington, 
D. C. Staff; RCA Staff. 

Summary of First Week's Activities \ ^ 



A. ^ Deriving U^eaming Competencies 
l.\ BehavMral Analysis 



2. \ Using 'lask Analysis to Derive Competency Statements 



B. Writing performance Objective 
' 1. PreHsse%|Ben1i ^^ackcige on Performance Objectives 

Monday-Tuesday > 3/2^^^ p Writing Performance Objectives 
A. Pftrforasmce Obje^:tives Defined 
B» Components of:^Perf ormance Objectives 

C. Writing Acceptable Perfo|mance Objectives 
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D, Classifying Performance Objectives 

E, Establishing Guidelines for Developing Performance Objectives ' 
V/edhesday, Thursday and Friday. 3/27-29 - Writing Learning Modules' 

A, Int2;oduction to Learning Modules 

B, Develop a Format for Learning Modules 

C, Develop at Least One Example of a Learning Module in Area 
of Expertise 

Again it jpatn be stated tha,t the RCA team made direct inroads into 
successfully meeting the prescri'bed learning objectives. The same 
facility problems and lack of teaching'aids dr limitations continued to 
plague the instruction process. RCA staff required to. conduct a 
contract needs assessment and rem^n very flexi'ble in order to rfeact and 
to emphasize aoreas of need as determined from day to day, 

"The Assistant Director^ for Staff Developiijent^ D, C, Schools indicated 

that she_felt the most important part of the instruction being advanced at. 

t 

this woricshop was the format 9r standairdized process and th^ writing of the 
leam}.ng packages, \ This ins-B^ction regarding the development of the 

\ ' ■ , - 

performance objectiv^j the -tedphing and learning conditions; the evaluation, 
yith emphasis on "measurable o elective of performance" was well presented, 
^ Throi^^ghout this week o*f wo^shop, the average teacher/trainee \tten^aJice 
vas eight. One new teacher/trainee had not attended either! of the previous 
workhops either in the summer '73 or the previous last week of February 'y^. 

Needless to say^ this individual was very frustrated and lost within the 

\^ ' " . . ^ ' • • ' 

context and materials used for this training xjeriod. The week culminated 

in the trainees presenting their written learning modules* and teaching 

plans for the one exercise they had undertaken in their area of expertise. 
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^The completjed exercises were handed in, critique on-the-spot with the 
trainee and then taken back to RCA Education Services, Dallas, for a 
detailed review. 

During this workshop, the Auditor/^valuator adn^nistered the ten- 
question opinionnaire du^ng ein interview with each of the teacher/trainees 
(see para. Data Presentation) using a structured interview format. 
Of . the 10 teachers interviewed, only three had not attended all three 
sessions of the workshop (see Item No. The summary femarks in support 

of response analysis for that instrument are presented in TABLE 9 — 
Analysis of Summary Remarks on pages*'59-61 , 

Following -Ihe completion of the workshop training, the teacher/tr?iinees» 
were to return to their respective instructional assignments and to complete 
the- school year.' There was deep concern within the group as to how they 
were to be utilized as a "curriculum committee". They were also woiried 
about an expected additional workload on nights, weekends^ or the possibility 
of s^^nding a summer of work without-stipend. 

The evaluation of the workshops did not extend beyond the mail-out, 
completion and return of the prepared questionnaire instruments* \ 
The specific questionnaii^e ihstrumeTits developed SLnd utilized ai^e 



discussed in Ch^t 4b, paragayaph 4 .6f this section of the r^ort aiyi are 
displayed at App. t^l and App. #2 infection IV, Appendix, ^he comparability 
of responses analysis provided some interesting insights into the va^e 
of such workshop training wh§n coraparVd to a randomly select group of 
peers, teaching in the same school system, in the same or equal vocational 
atmosphere. Particularly interesting were examples of experience questions 
and the subject of development of contei>t outlines for cluster programs 

' • ■ ^ ' J oJ 

or curriculum. The conts^ol teachers, Coitfponent B, had 80^5 of the respondents 

■61 . / • V 
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completing two curriculum Qutlines while in the program teacher/trainees 
Component A, even after this training, only .50% of the respondents 
could indiate participation in one content outline. This would appear 
to indicate a more experienced curriculum 'development capability in the 
, Component B, control group. 

There are other indications of experience which have good compara.- 
bility of Component 3, control teachers, to Component A, program teachers, 
and the Stated objective of completion of a curriculum and St^f Development 
Workshop. The response to item indicates the agreement that 
team work in the Vocational Education and career programs wa§ the most 
productive way of accomplishilg their educational goals. When queried 
about the actual publication and use of goals, the Component^ A, program ^. 
teachers agreed 100:1 that the* Lemuel A. Penn Center had purposefuly, 
established goals. (Use in the center wil^ come with program implementat^- 
Seplember'1974). On the other hand, the Component B, control group only .\ 
indicated a kCft agreement that Vocational Education goals are established 
and used within th©^ D. C. School System. 

The response to the Philosophy and deals statement questions for the 
Carepr Development Center, Item #11 Component A, dealt with the specific 
"seven goal" statement published an^approv^ Ijy the D. C. Schools Staff. 
The question was designed to measure knderstai\ding and recognition of 
the statement instrument^ Only one or\25^ of the sample responded and , 
with the proper response. The lack of Response on the part of 75/" of 
the sample we feel is an indication of lack 0/ participation in Working 
up this Philosophy and Goals statement as well as an indication of 
either not being provided copies of same or l^ck of sufficient eij)hasis 
in workshop presentation. Certainlj, the Philosopl'J^^^of^d Goaik of the 
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Lemuel A. Pean Center, as well as all Vocational Education in the 
D. C. Schools is important, to the teacher, more important to the 
curriculum developnient personnel^ and fiost important to the School and 
Center Staff- smd the Superintendent* , * ♦ 

In the development suid use of performsuice objectives only Z^fo of 

* • • 

the Component A, program teachers, rated overall objectives as excellent 

while. 4C^ of the control saraple rated, their development stnd use as excellent. 

As can be ^een by reviewing the respons-es, it appears^ tha£ the bulk;of^ 

the curriculum and staff development objectives of instruction were 

designed specifically to "set" the standard for the 6^eer Center; but, 

that these items of concentration did in fac,t ha<re^^j;^tige and were of 

knowledge and within the capabilities of the peer teachers within the system. 

It also appears that a broader ^taff training pirograra in curriculum 

development an4 standardization could have been, ca^rieci out withi^lhe 

Vocational Education teacher giToup. Only pre-agreed formats for standard 

forms ^and the desired procedures would have been necessary prerequisites. 

It is believed that such instruction could have been presented on a regular 

basis as in-service training within the pareer Development and Voc, Ed. 

programs on an on-going basis. This then couid have been followed by a 

concentrated period of input to \the career development, and curriculi 

writing team, ^e tend to agree wVth the instructpr^^neral remarks 

that while they feel capabjLe of writing curriculum and learning modules ,\ 

.tl^eir work would have to be reviewedj^d technit^ly finalized by someone 

more qualified in the field suid art of creative module writing. • 
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TABLE 9 

Analysis of Summary Remarks 



\ 



Opinion 
Question 
Item No 



1- / 



Only three said they had copy of published t 
statemerrt. Most were unc^^ain of objectives 

of the Center in* some form or manner of speaking, 

V ... 

2, All were "selected", but only four considered themselves 

"volunteered," * ^ 

3. ^ About 50/50 split on workshop objectives and 

.tinder standing them. 

Seven completed all, three of ^ the workshops. 
\ One had missed part of the summ^ workshop and 

one had not been available for the summer work- 

\ 

shc5p smd wa3 ill during the second wok^shop, 
V Februetry 25th to March 1st, 

r 

5i Only two trainee^," felt at ease with the worifc^ 

shop smd ^teaching techniques, Ii^olveinent was ^ 

ranging up to a h^vy frustr^ttion factor ^or / 

- eight of the trainees, . 

6', Eight* were working in* and assigned tii commupica- 

• • \ * * 

tions and media curricula aorea,! Two were workr 

• , '•■ ■ - -/ . 

^ ' ing in finfe 'arts aq^ TOmamities Jbut assigned to 



modules of the communication and med4a curricula. 



TABLE 9 — AnalysJ.s of Summary Remarks (Continued) 



page 2 of 3 



Opinion 
Question 
Item No> 
7. 



8. 




\ 



Five considered the Hsuidout Materials at 

<■ 

raid-range value but y\th reservations rsuiging 
down to low scale 1 on a particulaor worjjshop 
or area of instruction. Three' considered the 
value and helpfulness at a four level with sorae 
particular reservations rstnging down to 1, 
Only two r^ted thqt material in't^he highest 
scale and- on6, of those had deflfiite reserva- 
tions down ^o a two level ori the 1 to 5 scale. 
Eight considered thepselves as* working on"^ 
their own 4n the curriculum development -fcask,' 
Seven of these indicated concerns of the 
committee development procedure, one stated 
that' there was sorae committee work since other 
^chers. were^ "briefed" upon completion of the 

worlfsHop training, ^Two considered the workshop 

\ 

staff development training as curriculum 
6oWittee development, one indicating a trends 
toward working by self, while tlje^^her stated 
that there was no committee effoirt in \is 
knowledge outside the' workshops, \ 
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LE 9 — Analysis of Summary Remarks (Continue^)- v 



Opinion' 
Question 
Item No « 

; ) 9. 



10. 



\ 



page 3 of 3» 



\ 



About a 50/50 ^plit on the development of a 
purrlculumi outline. Some said they had come - 
iy with an outline or bUart, others had recently^ 
developed curriculum for new courses but, in* the 
main all indicated they would have to rfethi^k 
their area and start by developing their out- 
lines and thinking into new learning packages.* 
Seven had real reservations about what staaiSlcirds 

smd (how) the procfess to be used in developing 

k ' 

' curricula. 

All the trainees considered themselves 
competent enough '''to "write curriculum ^packages. 
Their chief concerns- were thdse of technic^ 
writing and the need f ot soiirce and \ontent 
^pefcialist. Seven indicated need^for d^irriculum 
development team eff or.ts and most^^ \h^^even « 
were doncemed with possible- ^additional workload 
(while teaching) as well a^ weekend or' summer 
„or. .UHout stipend. ,0„. conce^^as to 

fether administration was really serious abouj;. 
a^^^iculum development team. 

'. 66 ■ ~~ 
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6/ Evaluative Commendations 



The Acj^ing Director of this R & D effort was faced with almost 
4^s\innou^ odds which' were graidually, though rather slo'Wly, 
•overcome. Working intermitantly and only able to provide a limited 
. "part t^ffi^*effort to the pro^ject coordination and management activities, 
. h|e, peitelsted with cLrrangements to establish the Phkse I training; obtain 
the contractor for teacher/trainee instrucVioni obtained that contractors 



support activities for a^summer work3hop, when in fact, a formal agreement 



contract did. not yet exist. During this aforementioned period he was also j 
the prime mover and cootdrinator to establish th4 contractual renovation ^ | 
Dlans for the center. He was not able to transfer^ some of these "additional" , 



. * job i;^uirements until'^the apjpointment of the new Center's Principal/Director 
in Novem^r of 1972. The Acting Director is Commended for his persiW^nce 
and continued attention and effolrts [to ensure project' completion and a 




\ 

ooth implementation of the Lemuel A,^ Per\n Center, 



T!iie RCA Servic^ Conmany's Consultant Staff is commended for meeting 
mostsdiff icult training situation "head on" and retaining their composure 
and flexibility. With almost daily chs^nge requirements imposed in order 
to meet the project and teacher/trainee peeds, the Auditor/Svaluator feels 
that they rose admi2;ably to the challenges and provided a stabilizing and 
standardizing quality to the workshops as well a^ standard formats and 



\ 



procedures for the development of the Center's. curriculum and associated ' 
learning modules, • ^ ' 

The creation *o/ the* -Lemuel A, Penn Ceht.er was provided a vehicle f^or^ 
greatljr increasing^n expanded shopping list of vocatior^al training. Increased 
options of learning available to those students who desire ^ job "entyy level" 
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skill upon graduation frqli high school is m^t commendable, particularly 
so Kh^n- coi^ibined with other master 'plan leaning program expansion 
.within the D. OU Schools. % 

, , We commend the teacher/trainees for maintaining their composure 

% • I ^ . ' 

and dedication to ,th^project even in \he face of the mny delayd and 

progTcun changes. Many of the^e teachers were very filistrated with theii: 

lack of 4i2:ection and understanding yet still worked toward the staf^ 

d*evelopment (team work) and curriculum development, putting in many "e^ftra" 

hours for which they received no compensation or reservation. Their 

performance during Phase I and II of this project injplemeirtation 

has, as a group, been dedicated and commendable to the system. ♦ 

The RCA Services consultant team was well equipped with excellent • ^ 

trainir^^Hiate^als and workshop hand-outs. It was apparent tKat they were Jk 

able, to draw upon a large reservoir of such materials, subject based upon^ 

previous or other on-going contracts. Their experience ^n the field of 

jieacher/trainee workshops and curriculum development pifoved to be * 

most helpful and served to fulfill a very necessary need in the ^ci^i^lum 

development process. Because of this^ponsultant teams knowledge and 

capability, they were a^e to maintain the flexibility necessary ,jJto 

respond to delays, time changes and- program changes while still meeting 

the bulk of the program process smd product objectives set for thera. 
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1\ Evaluative Recomiendarijoas' 

~ — '' ■ 

The. overall program plan and stated pro^Ct 6bjective5 were too 
extensive, to be- accomplished .in the initially programmed.* timer Pieriod. 
The extensive. expeetanciW ta bS^f or1?hcoming *fram a: six yfeejli workshop were ^ 
badoCLly a planned impossibility ✓ The Auditor/Evaluate r would recommend 
comple.te reprogram of any replication atteij^pted, ^uch r eprogramming to 
include cpnsidef^tion 6f establishing, through* Un-housej curriculum 
.an^ staff development capabilities, 2Ln|/o^;^ by consult^ts serv^lx^a-HecnttAct , 
a- Phase I needs atssessment^ program development, philosophy *and goals, 
as Weill as Project st^niards and formats for curriculum packages should 

/ ^ 

be developed. Af^: these iiHtial ph^!se activities 'are ^jnpleted, a Phase . 
II :f^finement of OTKial curricula, 'maitching and using Available ^module ^ 
materials and the- proposed subjective matter for new curricula writing 
would be input over t*he period, of ,the follo>|lng scjhool y^^t ^^^^ in-service 

participation by flS. "teachers amd j^nvolved $taff teachers, the actual 

• , ' ' ' * ^ !1 ' 

curriculum and learning i^odule W3fiting ^ould be completed 'by professionals 

t 

•technical writers, both in-systea and hire^ as required. The writing- 
• could h'felp team effort started over tne.l^t two months of the school* 
year and continue through the ensuing summer period witi i^hase III 
expected implementation, the following school year. The PriRcLpal/Director 
and his select ^staff should ha^ ample opportunity for revi^^w and change 
recommendation throughout the 'curriculum ^evelo^ent process. A similar 

period of staff ilevelopment should hovjever be the Princjlpal/Directoiyand 

* * • ^ \ ( 

select st^ff^s concentrated? In-service training. There ||te.nec^ssaiy 

stand^i^s of instruction documentation, Evaluation and management, which 

«U§t be similarly developed^ for impleiifSntation. If the standard for \ 



Idddins letting -renovation contracts to^ th^" proposed buidlirig . 

si-te Is ^^rirAned to be the major time line involved^ in tKe project. 

Then we l^coFunend realistic planning, constant evaluation^ and' change 

.only as absolutely required to input supplies^ stnd equipment and utilities 

support into afi!' operational building for #h5 leamihg st^ations planned. 

Any curriculum ai^d ^taff development program can suid should be conducted 

^spearately in our estimation, liruipraent, 'materials, facility space . ' 

• * * _ 

allocation and seftware iterj^ shouldTlT^ coordinated atnd pre-planned. 

In most instances , ^the curriculuin learning mojjules will be written by the 

•profess ioiiaiJL wri/'^r^ In oyx^ view, we recopend that teachers be.us^ and, 

treated as t&chers Within the school ^system, not as curriculum writers 

or archi^tects ar d contracting, engineer s,'- 

We pecommeAd that selected teacher/trainees be trained in the Workshop 

of in-eetvice training vehicle which^is provided and not be asked- to obtain 

a 'isecozl^ hpLnd" passing on ^of learxfTng^xperience and materials , through * . 

one who has had the oppo2;tunity of participation. This is particularly " 



€rue jfhen a teacher •s "own time send flree 
or her learning process. Stipends- should 



time** becomes involved in his 

be available to pa^ for substitute 



teachers in the event 6f r^uired activities outsiUe a ppograjpied in-service 
program.. Of the selected teachers for trie proposed I5 teaj^her/trainees, ^ ' 

only an average of eight (8). were "trained/ in the workshop sessions and 

. ■' . \ ( • ' 

within this number there were many partiadMiaY or^eriodv^bsences due to t 

•teaching and administration xequiremente. 

Career training, is a very worthy currreula effort, particularly in 

today's ^3cxb market and student needfe. We recommend that full consideration 

be given t^ augmenting the master plan of career benters and vocational train 

ing to include career educatioj^in adl grades K through 10th. This, in order 
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to.' prepare the. students for better ^election, 'based 911 knowledgeability 

of caxfeefs aricl. job -skills required therein', wherf offered the options * 

of skill ^tjilning -in 'the D. .C. High Schools, Counselling' and guidance 

personnel should not be expect^ to carry the full brunj of a^sistamce = 

in and with the siudetts career sej-ection suid learning a skill trade. ^ 

* . ^ - 

Trade organizations suid" the community should be given the opportunity to 

work with the school system, and ihrough the system to exert their own' 

assistance, and desires, for ttaining manpower for stciffing replac.ement 

needs a^t the "blue collar" Jobs available. . . / , ' 

Ve would recommend the pre-planni^ngT^Ph^e I, orgatniz^Ltioh of advisory 
committee^ and community assistance to give active assistance. with planning 
aipd proposing the prograims of instruction.^ Much of the .assistance 9btained' 
during this- project was on a person to person basis, and not an 02:ganized 
.and operaTble committ^ basis to react to ax\d. support 'consumer deniand's* 

Too much of the \raluable* teac'her/trainiitg time was utilized in the 
.building survey regarding renovative pians ajid con£ractual activities. 



i/e recpmmend that 
architect outside, 
D, ""C, Schools 



^uch cc 



coordination, be 



accomplished wit"h 
such formal or In-s^ice training prx)grams. 
Philosophy and Goads statements, when consumated and 



the D. C, Schools 



published, should [be provided to each staff and teacher incurabenl|, : Many 
of the responde^ils indicate lack of goals or guidelines to direct .their 
instructional' efforts. We recommend a review of this program to ascertain' 
that all teachers 'and staff members have', understand, and apply their 
educational eff02»ts to fully utilize the published goals aAd guidelines, 

rfe recommend that the -Career Cluster Programs be -fully augmented with 
completed learning modules and teacher lesson plans as soon as is practical 
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under the current funding and manpower limitations. Decisions mu^t be 
made regarding those cluster programs'in th^ arts atnd particularly ^he 
humanities which are*to be retained at Lemuel A^^^iPenrv Center or offered 
elsewhere within the system. This project seemed to conflict in proposed 
career clusters with other programs be offered as example at rfestem 
High School. Proposed program clusters included music, and yet the 
music program planning was incomplete arid npt' car^abie of development as 
»a progfan.for Lemuel A, Fenn Center due tp lack of space. 

We would recommend that every eff ort/^e" made to. provide a training ' 
atmosphere more suitably proper for/^ult teacher/trainees. Seating and 
table arrangements are of utmo^ importance for the conduct of a continuing 
hoiCr-upon-hour workshop. To b^seated in a "squatting" position, hunched^ 
over an intermediate student table is not conducive to the adult^ thought 



processes. Proper back-up aids of blackboaici/^equate to the full view* 
of all particiDanjts smd the avail^ility of Vu-graph or some other hardware 

" /^ . - ' • 

item capable of projection of transparancies does not seem unreasonab 



as possible 



. i 



for good instructional support. Discussion of topical matter must be 
controlled to Iteep trainees "on trade with the trai2)ing objectives" and to 
^ensure elimination of as many personal prc^lens or ego serving situations. 

any such interferences were! observ^ and undue .repetition 
^diluted /the learning accoi^plished. Such lack of control by thjs consultant 

staff precipitated per^onJjL arguments between trainees on more thain one 
• occassion. , o ^ 

It is recommended that future agendas for training of teachers in 
curriculum development contain a more extensive time elemept devoted toi • 
standard formats; development of the peirformance objective; teaching 
and learning conditions; evaluation which emphasizes "measurable" olDjectives 
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perforiJancej and, more fUrst person advispry aiid correction assistance 



by the initructors aiii^ staff. 



We w^uld' further 



reconfaend ^Hat the. us6 of published standards, 



a policy and procedures ma4^ual cind standard formats for learning modules 
and teaching plans be established within the 5*taff or worked out under 
contract with consultant. These^materials.Vtaai^e av^ilablf to the selected 



teacher/ tr ^nees woihd th 



^s circumv^t the reseairch and development time, 



\ 



effort, and dollar^ which wen.t into th'e initfal program frustration for 

/\ '''^ 
traineJ^s. *fhile the materials and recommendations made by ' 



the RCA consultants ve3^ for the .mosi part valid and accepted by the 

necessary^to po^t oi^t that little" "new" 
durfhg the workshops. 



concerned staff, wp feel^ 



hater ial -was de veiled 




\ ■ 
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B. Major kukit Responsibilities 



The audit responsibilities Were approved, and stipulated as propbsed 
♦ ^ 
by the Audit/Svaluation team, ^hey followed progrcun auditing techniques 

y 

based upon external reviews des^gn^d to verify results of the evaluati6n 
and to a,s^ess the appropriateneiss of internal procedures for de"^ennining 
the effectiveness of project operations and management.' As one of the 
major tasks, an examination w^s made of project records in order to determine 
the degree to which each of the preliminary steps to curriculum and staff, 
development were m^. Another major audit task was to provide periodic 
verbal reviews (report^) and, to- maintain close liaison with the project 



director. ^ 

1./ Data Collecti(^ Pi^^edures 

The primai^ collect ioji technique was to interview the Project JJirector, 
or as later appointed^ the^ Principal/Director, to question their development 
of a documentation system. The administrative activities of the project j 
and, to treview those documents and records available or wl\ich could 
made available to the Atiditor/Svaluator. Official recprda suid* docui|entat\pir 
were reviewed and -copies of the morj6 pertinent documents fere obtai| 
Due to the extensivev'ar^d^aried development of project ob(jectives in the 
initial proposal, ^d ^ change<i over the extended lifetime of Phase I 
and II periods t^ve^'project^ the , statement of the initially expected 
^ units of perfomance were vague or totally lost. This failure to follow 
specific' stit;6nent^ of cb^ctives of project Intent presented a great ^ 
difficulty Mthln both the evaluation and the auditing tasks. The RCA 
contract/Specif ied a statement of work which 'was "service** oriented to 
provide organization and execution„of the staff and curriculum development 
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program but stated no ri^uireraent and/or guarantee of teacher/trainee 

performance. There was also an extensive delay in the RCA contracting 

9 

process and the req.uested anendinents or changes were not signed ox officially 
executed by both pariies. Contract changes and actual service operation 
was based primarily upon both verbal suid letter instructions of the 
Acting Project Director. Such' changes of procedure made the "ISracking" 
of project (Operation difficult. Other documentation was made available 
to provide supplementsd data used by the Auditor in the 'validation of 
results of the questionnaires. Materials provided to teacher/trainees 
as well as the published instructions were ^Iso provided' to the Auditor. 
Throughout the project p^^od data collection was conducted by the review, 
pull-copy, and file procedures. Where a limited .documentation was encountered 
(or non-existent) return visits ^d further interviews with management 
and staff personnel were utiliz^ to obtain pertinent information. Int^nal 
"memoranda" for file purposes wef^ accomplished aft^ these interviews 

by the Auditor. 

\ 

2. Pata Analysis Procedures ' , 

Documented project activities and operational procedures were selected 
from the documentation file and comparative €Li\alysis^1c£ade with the observed 
project activities and stated opinion or judgment facKprs of teacher/trainees 
and proj^lct staff. -Anadysis of data was necessarily .lliait6d t6 determine: 
what 'was planned^ or how it was modified j» what was done by what, date, what 



will be done in 



the future, who is responsible, and what was the. condition 



as of completion of Phase II of the training in Kay 19?^. 

Interview responses and auditor's findings were then coupled with 
documentation in the analysis process. The procedure for data analysis of^ 
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the information obtainM from the questionnaires ijicluded the procedure \^ 
of J tabulation of the number and percentage of questionnaires returned; ^ 
tabulation of the number of responses for each alternate response for each 
item, and the number of non-responses for each item;, tabulation ^of the 
percentages for the previous procedure; tabulation of the number aind C. 
percentages of responses to each alternative for each item across components 
where the items, and therefore f^e objectives upon which the items were 
based, eire common to two or more components within the program; presenta- 
tion of the information in tabuleir format; ajid where appropriate, a graphic 
presentation format Analysis and evaluation of all materials was then 
followed by preparation of this final report, . , 

3t Data Interpretation Procedure 

^Project ^documentation was reviewed and interpretation based upon the 
auditors verification from operational program materials, statement of RGA 
consultant staff suid/or statement of teacher/trainees or project administra- 



tiv^ staff . Judgmental responses and statements of opinion were collected 
relative to the degree -of cohpletion the program objectives as stated 
or understood as project goals. As previously stated in Section I, the ^ 
non availability of the proposed follow-up interview did limit the breadth \ 

/ 

of materials and opinions available for the final overall interpretation. 
Product bbjectlves, as restated for sund within RCA contract statement of work 
or letter of instruction, were carefully screened sLnd observed over Pbas^ t 
II of the project, .Vfhere a divergance or lack of understanding was 
observed or determined through the <it(estioning/interview process, ' ^ 

shortcomings and danger areas Here discussed with the Principal/D tree tor 
and the RGA consultant personnel, 
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Throughout the actual auditing of the seminar/woi^shops, the ^ta 
presented and utilized by the teacher/trainees was collected and cross-^ 
referenced to that previpusly made available. Interpretation of actual 
use was a judgmental factor on the part of the Auditor with the exception 
of observed preparation of exercises suid first^hsmd personal |)resentationp 
of exercise work by the tether/trainees. In this respect, the Auditc«:_ 
did not have teacher/trainee prepeired materials made available nor were 
ther^ teacher curriculum outlines or prepared learning modules,, completed 

/ 

or made available for product objective documentation. Initial teacher/ 

trainee input of curriculum outliries and learning nodules as a classroom 

. .. « 

work-exercise was observed by the Auditor during Phase II workshops. 



1S 
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4. DaCa Presentation y . ^ • ' 

• \ 

In a staff itiemorandum to the Cor>tract Specialist, Negotiated 

Contifects Services Division, under date of September 20\ 19?3,'*the 

Assistant Superintendent, Division 'of Career Development Programs 

requested the preparation of ^ negotiated .services contract with the 

RCA Service Goro^>any \b perform, assistsuice with the project "Career - 

Developmerjir^ent'er." The services requested were to provide extensions 
^^^"^"'^''^'^ f * • 

"ofand 'to continue a curriculua and stiff development project of 
Augu&t 20-32/1973 (Phase I)." ' * 
Assis;tance required was specified as to: 

A. , Direct and establisVi techniqu/^s for deriving competency standards 
from program areas utilizing task ^^nalysis,* 

B. Review relevant curricula ajid related, research materials collected 
by school personnel dnce the Phase I staff and curriculum development 
conference (8/20-'3T77'3>i ' . ' \ 

C. Assist ^ establishing advisory committees and. identifying community 

^ . \. 

reso\irces as support for the two olusters^ \* 



h\ Direct and •establish guidelines for cfevelo^l^ng performance 
•objectives; ^ ' \ ' 

S, Develop and recommended format for learning modules for both 
clusters? j r ' 

Direct writing of at leaSt one learnirig. module per program area 
suitable for instructional purposes, 

^ The RCA specialists needed to conduct these services were specified 
to include: ^ ' - 

A. One Program Development Specialist 
Onfe J^edia Specialist ^ 1. 



Ct One Curriculum Writer 

D. One Community Relations Consultant ^ * ' 
Phase II final reporting was also specified in order that a conWct 

could be prepared and negotiated fo:z: the performance ay these services. 
On the foll6wing day, September 21, 1973 f^he bu^et change ^^^t^est 

was submitted for the "Career Development C^nt^" Project., Project No, 

V36IO596. Grant No. D2G-73-2992, to the Program development and Operations 
I 

Branch, DyTE, Office of education. ' This budget, when reviewed by the 

Education^ Programs Specialist, DVTE, was returned for clarification 

< • i ■ , * 

' and justification of 'change items. In brief, the explatnattons were centered 

on the following change justifications tramsmitted to DVT2, Office of 

Educa1;^on pnder date of q^^pber 3, 1973. They were: Allocation of Teachers ' 

Stipends , Y<n^iginally based upon fifteen teachers stnd a six weeks workshop. 

A balanc^Qf ^13,311. was justified as reprogrammed to RCA Education 

Service^^^bstitute teachers, and consultajits in'* ovdbv to conduct the 

reprogramjje^ workshops in November and DecWber o£ 1973. Secondly, 

with that ju^if ication' was the added presentations of the ^ delay in obta^- 

ing a contractbri> in sufficient time to conduct the\six weeks workshop, the 

ne'ces:sity to shorten the* summer workshop to two weews and to ensure the 

\ ' ' ' ' ■ \ 

i^CA^specialis■t^ continuity in the program beyond this first phase effort. 



Theithird area of discussion clarified the incorrect IJLsting of a portion 
of the salaries for ^ curriculunv. Specialist and jstaff .development coordinator 
under the cost of sharing state and local funds. Since^ these salaries w'ere 
paid out of Federal funds they could not^e uSed as "local cost sharing". 
It was necessary to replace these line items as partial salaried for a 
TSA-8 assistant princi^^ii and a TSA-I5 counselor paid rrom local funds 
and used for this co^t Sharing. All items and reprogrammedv dollars were 

/ 79 " ' ' 
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^accounted foi; within the original allocatipns approved' in the grant. 
The r^uest was approved and s'tai^ped signed as "no additional funds 
' atithori^ed" by the contiracting Qratnts officer, - - • , 

On October 31, 1973 a memoranda to the Project Supervisory Director 
from ^the Contract Specialist stated that "funds for the subject amendment 
which had been processed and held since October 1(T, 1973 were still not 
.availabler' The request was thus returned to the Project ^irector, with 
the statement "when funds are aVailabJL^ please resubmit allowing a 
minimum of forty-five days ^processing time, " * 

TJie acting Project Director^^^antt newly assigned Principal/Director 
were required to retrace the v^ious reprog.ummiing actions stnd requests 
through the Superintendents Staff, School Jfoard apd government of the ^ 
District of Columbia, Bureau o^ Material Management, ^ 

\ 

An Amendment No, 1 was issued to RCA Service Company contract No, 
7kQyz by the D, C, Government Bureau of Procurement which was an Amendment 
\ of Article I Statement ^of Work and added (but did ndt substitute for 
{previous statement items) six. tasks with stipulation\W 30 man-days- work • 
over two one week periods-tentatively November 5,and^cember 3, I973, It 
should "be noted that 'these dates wer6 tena^tive only an^were^ ^ot changed 
to reflect the actual dAes of ' performance later programmed. Article II 
Reports were amended by a^ins r^i/irements to be met "on or before January 
1, 19^4" a date lat^r chan^ by program slippage but not amended or changed 
in the contract amendment No\ 1 Article IV- Consider^tion and Payment deletfed 
previous language and substituted a fixed amount paytnent for performance. 
Established a new payment schedule and standard instmictions atnd, agreements 

r 

on invoices su^wiission, certification and subcontracts language. Article 
VJII Siual Cprdrtunity Obllg:ation transmitted the standard Equal Opportunity 
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Dbligation Statement required of all 'Construptors ahd subcontractors * ^ 
J the District Government. ^ 

As the date the Auditor Vreviewed this Contract Amendment it had ' 
not yet b^nr signed by the parties of the contract. It was not dated by 
either party and *not .yet note4 as qaving been .aqlcepted^'by the ^District* ^ 
Government. It is thought to .have l&een written as akpart of the wotlc 
accomplished in Octobar by negotiated .contract sendees which was returried 
as a package to the Project Director, October 2^1, 1973 fc^r lack of 
funding, approval ol rcprogrammed funds as requested. 

Electing to continue the operkt»ional coordination of Phase II, 
the Acting Porject Director and Principal Director arranged foAROA Service 
Company staff to conduct the two, one week seminar in-service' training 
programs. Verbally the unsigned Amendment No. 1 was discussed ^nd State- 

ment of Work accepted by the RCA staff. In both the verbal d^i'scussioqs 

\. 

and in a letter to tha RCA Manager ^^f Curr^£culum from the Assistant to 
the Assistant Superintendent Department of Caree^Cevelopiflent Programs, 
dated February 19, 1974,, Article I — Statement ol Work was modifiiedi 

\ V • M \ 

The process ^or the Phase II workshops was to accomplish thel Amejided 
Statement of Work format, As furtJieV changed by letter, to provid6-the 



services ""and direction as previously specified* ^ Uhder the process audit 
and ^valuation of objectives as understood bi^ the RCA st^ff and the Project 
staff, it was generally agreed that^ as stated in the management staff 
evaluations, the RCA team "fullfilled each ofl the goals and work objective^* 
There was one major exceptloii; that of the establishment of advisory ^ 
commity^ees as, per the &taten|ent of the Prin|cipal/Direct<r ,** little attention 
was directed toward establishing a syst6ra4tlc approach to selections In 
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TABLE 10— LETTERS OF EVALUATION 

FROM STAFF PARTiCIRANTS 



) 
\ 

/^sessment of -Curriculum and Staff Devslopmeat yorkshop 
Summer 1973 - Spring 1974 



. The Conmmnication and l!^dia-Fine Arts and* Humanities 
Curriculum and-^taff Development Workshop conducted by | 
representaciv^ of RCA Education Serviofe Division, in isy 
, opinion was highly successful. 

. Ac the^beginning \)f the workshop, August 20, 1973, 
'participants .from the vocational and academic schools had 
no previous experience in working together* The RCA ^ 
coasuitants ictanediately showed t^e participants commonalities 
between programs and* employed proper techniques* and strategies^ 
50 correlate jJlanning. After approximately one week of Working, 
cooperatively 'as a unit/ fine arts teachers were correlating 
planning and dra£tiag. ^nd printing teachers* .A very wliolesome 
attitude of sharing was develop^^ at* the very beginning^ of the 
workshop and prevaiJi,ed throughout the summer and spring Sessioits, 

* *' ' ' * • ' J 

Reports of participaints indicate tHap thfeiexperienc'|s *were 
most beneficial and vital to t-he development program 
*Iemu«l. Pfenn Center* - . -T* 







V ..TABLE 1,0 — LETTERS OF B/ALUATIOiN • 'P^ge 2 of ^ 

A- ' ' ' . ' ?ROM STAFF PARTIC IPAM7S' OCQntinued) ' * 

^y.^txm (Senter 
I.e. 2dll02 



an 



/ 

A _ • ' - : 

Voi(iM.ld VKican 
H VnlncQ. William Viivo. , 

■ ». .1 
VQ.CLH HK. Pxice.fi.: 

^. pfLogfiam dixectpfi' v] the. ,iifejnae.l 

-thli Zetten. ii wfLitterv.'in ^e^po'me* to 
atlve. data conc,en.ning ltwc JICA' ^t^f 

'l^l^ich.J wa6 a panticipan^t: ' (TebAutt 




enten. 
ofi\evata 

.1-974 



The e\)ataatl(m, h'a&yhe.f^ coHiid^eji in t'hz light two 
\majofL queitiom,, TIl^ou} ^ well. did' iM^ RCA Team accompl'iik-' 
the ma^ofi goaU- and objectives si&y 6 ttCtl'd vCn theii tonlKxiat' 
.\ : '-v A-^^ the ^xoce66 Hing about ob&zuvable changei in paxti- 
. » ; c-cpanXir rabidity to develop civixicalan. njoclale6? ' \ * • 

'fhe RCA. Team Itiiti ^ive majofi w'ofik objectiv;&6 cm page^ 
one 0(J tf{e negotiated &envice.i> tontfcaat Wo. 74032. - The" 
.^RCATea/n in my eirtimdXit^i.-^^illQ.d &ach-o] the^iive goal 
i>tatement^, ■adequately with one exception. Thii exception. ■ 
l-cited.Ui^) undefL the contract and fieiefii to the' eitab'^ ' 
'li&hment- o'i' ad^iipfiy committeei. While conven.iation^ 
. A.el'i.vant Xa th^'i fiime wexe indicated by me dufiing the 
. _ T(LbxaaxyZ5, 1 9t^ ■ 6Z66io'n6. little attention wa6 dlfiected r- 
• . toward eitabliikingf^t iyntematic app^fioa&h to ieZectiom , 

in thii axea. - osiluKe ' to achieve stated obj'ectivti in^tkii - 
' ^^-iinglz ajiea,^tend to fie^lect u^on the iacce66 zvidenczd in 
zach OjJ the ^oa\ lemaining aniai . . . • . 



pKobVim^en\fi^^npt'eKed by the teccm 
a kelalwo^ varying dzgfC6.e6 o^ p 



In." CO veiling all axeai 



we^e a fie&alWoi v^i^y^ng dzgfCzei o^ participant 'iamilianity 
WA.th CafLZZfC EdUcation,cgncef)t6 Hand may well have cavazd jthii 
ovex-ySight. a ' 

■ ■ •* • . • 

\0.biz/Lvable:cka.mgi.6 iA pafiticipant& ab Hit if to develop 
caKnicaloA' modules wa& in evidence as 6e66ion6. pfLoceede'd,\ 
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TABLE 10 — LETTERS 'of EVALUATION • page 3 of 4 

: i FROM STAFF PARTICIPAKTS (Contrinu^d^ 



■ . • ^afLticipanU on.ganlze.d an-d /latm&d iample. cJiaa activititi 
coni-LtieKin^ azzzptzd^mtthodi, ion modulz de.vUopmznt. Ob6e.fLvation 
■0^ 4^nd<v<duc^l6' in c.q.knyinq oat a66lgne.d taiki in a it>iviztafiQ.d and 
itfite-matic manmv ica^ zoKi^idnntd the. mo6^ 4>acce.6iiul 'atcompllih- 
tiftnt achieved by thi ttaw. ' ' ^ 

■ • ■ • 

. Jn iummafLU it ii izlt that' t\e.6c acti'ditiei . could only be 
v.(.gwed a4 a highly iucc'e:66iu.l ve.nthi^»<Ln bn.'XAging about needed 
cufLfi^cula-1 change, in' Viitnict^ SchoYli . 



I *• 



f . ^ SincefLZ.^y', 

- ' . ' Ga^p^gfe ^Coiiion . 

VinectoK , , . 4 



6CG:4ic 



TABLE io — LETTERS OE EVALUATION ' \ ^ page 4 of 4 

. FROM STAFF PARTICIPAKTS (Conhnued) " . 



I - 



DRAFT 



aar Mr. Pricer: 




; — T 



This^letter is ^ give you my asses^jaent of the 
curriculum de^vc^opraent workshops l&ll 5or teachers and - . ' 

staff at the Lenniel Peon Center Career Developnent Center during 
sunjuer oi 1973. and Spiring pf 197,4'. The woirkshops were (jonducted 
by the Educational Services -pivislQn of the RCA Corporation. 

- I fouiid 'the RCA staf| Co be.yery re90urcef)Lil„ 'tHey readily' 
identified- the feroblBms and needs pf tl)e* group and developed the 
appropriate strategies needed to work at^ meeting these ;;ieeds. ^ 
' The workshops were well .prganite'd with a suff icietit amoi|5t' 6f resource 



.Material?. needed to accomplish the tasks. 

* ♦ 



^ ^e teed back I received- from the workshop participants was 
generally favtDrable toward the workshop activities and Che workshop staff, 

' I hope that th^se statements are sufficient for yoa in your;task 
of ev'aluating the pro'j.ect/ If there are additional spjecifics please 
feel free to contact me. ^ 



'^^SincerUW 




JosieT5.^SQle 
Assistant Diracrtor 
Staff Deyelooment 



this a^ea. Failure to achieve stated objectives in this single -^rea, tend 
to j^flect upon the success evidenced in each of the four remaifft^g areas." 
Staff -process evalyajiions werfe requested from four D.C, Scho^-^ Staff 
members, Threepere actually submitted and* one attached TAB 10 — Staff 
Evaluations '(1-3) . ' ' . 

The Prpject Management 's^roceis extended througKout the iJeriod of 
initial planning ^d until November 1973, with the assignment of *the Principal 

I Director, the additional responsibility of the Acting Project Director. 
When .assigned in November of 1973,, the new Principal Director began .th^ 
process of building the separate Project ddcumentatibn ' f ile . A system. was, 
«6t In bfeing .or fonnalli^ developed. ?il^s wer'e built from th^ management 

^ actions and documentation of the several a-ction agencies involved a^d required 
considerable time. to compile. / 



Staff and curriculum development! for the'teachef trainees was initially 

' ' . f ^ " ' " , 

planned to be conducted on Saturdays' and eV^euings during the first semestet 

1973-74, per memoranda of instructions dated June 25, 1973 and signed by 

the! then Supervising Director i Audit of the process indicates that thife 

additional staff apd curriculum development ^trai^ing did not develop and 

only those exercises /hand-outs)* used in conjunction with the workshops 

(|/25-3/l/74 and 3/25-29/7*4) were used to accomplish this process, outside 

the workshop tl«e per iods^\ Phase 'II . * • . 

The Principal/Director provided teach^f/tyainee assistance in^the . 

development of staff and curriculum responsibilities under 'memorandum to 

Qenter (select) Personnel;' dated February. 7, 1974, *6 definition of the two 

♦types of .evaluations (to be used as concept policy), an outline of. the 

/ ^ / • * . • ' 

Summatlve Evaluation Model to be^ used for che Center and a copy* of selected 



mater'lals to/ serve as standard for develof>ing behavioral objectives • The 
•staff -was request;ed to 'include the development o( plans for evaluation 
i(fonnative) for all internal prograM^ fr6m this date forward. The RCA staff- 
^ carried, this process ii^to their instruction and work$hop activities and 
the comparison of student development to the stated program x)bjectives. 



\ A Foriaa-^ve Evaluation 
Di^ecCif^ knd Assistant Direc 
internaj^ evaluation of progt 



197A. * Goa^s revision becaipe 
February 25 thr6ug^March 1 



Ilodel was conceived and published by the Ptincj|;pal/ 
or of Reskarch and Evaluation to spetify the 
ms anS 'as a guide for process aft^er February 1^ 



the first order- of b.ti^iness in th^ RCA workshop, 

'i Ml 

197A. Internal evilii6tion was thus made part 
of the process cyf^wor^hop ind cur'riculum develoym^At throughout the spring 
of 197^% ^ 

The^fina]/ pMTocess activity considered herein and documented by the Center 

I^rincipal Director was th^ of follow-up action on the workshops and cyrri- 

c^lum development. A staff and faculty meeting .was called for. Che Center on 

April 30, 1974» Major tgpics of discussion and action were: 

\ 

A».^ Summer 1974 schJadule planning - ^ 



B. Developcent of /curriculum modules 
C» tJse pi braphirf Arts 

D. Impleaentatic/n program and plan — 197A-1975. 




, A\i^it 



Conclusions 



Arr obvious concfLusion can be drawn from projeot progress to date:^ /that 

/ ' c * * % I 

the planning and e^pluative capabilities for the implementation of a hiL\\ 

school level careejc d^evelopment; program is almost one year behind the .pfTo- 

posed and planned/project ijnplementation date. Short of not being abl4 to 



inimed lately obtain a consultant, contract to* provide the assistaiice with 
curriculum and staff dev,6lopment workshops, the building renovation delays 

in toRjtracting and constructing would have dictated such a delay. In short, 

*• ■ , * ' 

if the original plai\ni,ng had been followed to provide teachers and staff with - 

the necessary trailing and guidance required to provide curriculum writing, 

tl^^major delay in the building renovation track would/Still have delayed 

the project until its completion in August and September, 1^74. ^ 

If thefee two major project delays could have been forsaen, then a more 

appropriate projecT^eacher and staff training process ^might hdve been devel- 

oRed for funding Under this grant. The fact that a full 'time Acting Pro'^ct ' 

/Director or Coordinator was not assigned to these management responsibilities, 

was reflected' in the general staff support attitude encountered by the Auditor/ 

EvaluatorT This reflection of l^dership and the "built-in" bureaucratic 

system delays appear to have taAcen their tool on project success. Much time 

was wasted ^during the workshop| in order to orient, quest^n, ^^mmend 

change and plan actions, i^hich should h^ve been foreseen and an aLternate^ 

plan of action established to alleviate the srtuation. Teacher/ trainees* 

rbally and in questionnaire response, indicatedN^ay felt "left put" of 

^|tb4 planning main stream of the project^ and farther, that when they did 

develop recommendations for the €^nter' fSfcilities and operation, that ^their 

change in*-put'was that of ^ wasted effort when not used. Even if thej 

recommendatipns and individual effort were not used<; certainly their efforts 

should haVe been acknowledged. 

^ The delays of building repova^tion were such that the planned audit of. 

tba^^ fatter of cost transportability was no't fea«ible^ The delay in obtaining 



the supporting contractor for the curriculum ^nd^staff development training 

• ^ > / 

was (irr order of encounter): A), U^OE approval^ which was a period of 

\* 

approximately five months; B) RCA Service** Co^^ a' responsive bidder, bgut^ 
establishing some new direction within their proposal vjsa-vi the D*,C., 
Schools proposed R&D Model as stated to USOE; C) Contrac^J^Eng^ Coordination 
and negotiation, both in the Curriculum and Staff Development Area (RCA 
Service Co.) with majo^%iodif ications in September and October as detailed 

in Section II,' B, A, and the contracting of wprk based on the* architects 

<• ' 

actJLvities to meet building renovation time-tables; D) Request for Proposal 
for the third party Audit/Evaluation was delayed during a sear^ih for expectfed 
respondents, in fact this Auditor respondent was advised of tentative 
selection iri September of 1973 but not formally offered contract until 



February 22, 1974^ a five month delaj^ and three days after the start of 
the first <?f Phase II workshops by/the RCA staff; E) Contractor work and 

1 

materials delays in the building renovation contracts during the. spring 
semester 1974, with Contractors changes leveled at "plan changes", al^o 
causing added delays and 'stretch out. ^ 

The^e then, were the toajj^r delay factors encountered in the R&D 
project and the building renovation program nece^ary to facilitate implement 
tation of the Center and educational program starts. 

^Many of these^ management and coordinating jobs were hurried in a model 
of administrative actions and interrelated approvals which would delay the 
best planned project. The community r^ations specialist failed cqmpletely 

to follow ixp aiid establish?Che very itnportant community advisory committees^ 

> ' . • , " *' 

ojr to adequately identify qcjmmunity resQurces. .Much of 'the recommended 



format and standards for .the, curricuiiiin modules and staff writing came 

directly from the RCA staff with lit.tle or 'no input by fl.C. School staff 

^ ' ' \ 

and/or in particular from the teacher staff ia training, Thrls is not to 

say however that their us^ by the teacher staff 'will not ^ over time, modify 

and improve their present ^form; or/ that fhey.are inadequate for the expressed 

need^of the project.. Acceptance and better use would have undoubtedly 

•resulted with a closer tfeacher and staff participation in their development, 

^* Section II B, 4 details the use of contract change procedure outside 

the authroiti^s stipulated to the contracting offiqer. Since this contract 

de^lt with a Grant from USOE and not carry over funding Ireprogramming 

of fund^ by D.C. Government may r^ot be a particular problem. The Auditor/ 

Evaluator however was unwilling to accept word-of-jnouth or letter^ changes 

as le^l and formal. In fact, due to delay of receipt of evaluative materials 

the Auditor ha-^ been' for^d ^o extend reporting deadlines of stipulated 

contract atrd^^e change appfoval period granted.' 

Change justification ^to USOE, necessary to preprogram f und^* to "stretch" 

the project time- lines ^d required services, again met' with an inordinate . 

delay write similar to initial Grai^t^approval but were finally approved, thus 



r 

> ensuring continuation of the training and contracto'r continuity. There was 
eyt^nt delay ,awaiting^this approyal action within the D.C. Government ^ 
Business Management and the Ne^gotiated Contract Services Division. These 
delays forced contractors to accept^ the risk of work statement"* change action 
without a formal approval of sajne. The Acting Director assured all parties 
of his direct assistance in coordinating reports\approval and final payments 

« m 

I 

(a verbal assurance) . 



, The RCA Service Company staff, though short in numbers and Xime, did 

meet all the Curriculum and Staff Development objectives for th^ contract' 

with the exception of the establishment of Advisory Committees , a rtd Communit;y 

Resource listings. Teacher/ trainees and D.C. Schools staff geherally agreed - 

that the contractor adequately met their objectives. The strtictured procedures 

for development of the curriculum modules and the assistance /in modulan 

develepment and writing is considered the most valuable contribution by \ 

the RCA staff.. The individual staff members were found to be most successful 

and experienced in 'needs assessment, roi^*' playing, and relating to individual' 

trainee problems or lack of understanding. The RCA Educat^ional Division 

' ■* t 

resource materials were excellent and quite extensive. In fact, there 

' 4 

were times encountered in which the resource materials contained too much 
dep^h of content and were thus o^onfusing when ''Allocated to the training 
requirement and specific programmed development for the Center. 

It was appparent that the Center staff and program teachers' were still, 
'^behind'* in accomplishing the curriculum modules and teaching plans necessary ^ 
to implement the 'career education program in the fall of 1974-75, Of all the^ * 
cjliri^icuium programs proposed in the approved program listing a^ of May 15, 

- 7 ■ . ' ■ .- 

1974, .approximately eight percent wer^ in some modular form identif icatiorv 
or writing. This represented at least one module p^r individual teacher/ 
trainee workshop effort. These modules', were discussed with the individual 
trainees and returned to RCA Educational Services ptfices for rewrite and 
finalization as time permitted by the RCA staff. ' • 

In the judgement of the Auditor/Evaluator , the direction and/or model 
for t*he program evaluation within the Center is adequate for planning input 



■\'' ' ■ " • ' 

to date. Actual practice and operational activities will provide change/ 
needs assessment practice and refinement ^'^l^-the program progresses. Develop-, 
ment of objective task measurement of the learning* process was^ assuted within , 
the curriculum module 'format for each module and teaching plan. " 

, Returning, to the original proposal and the preliminary ^teps to curriculum 
and staff development which were to l)e carried out, cc^c^^Jtual changes were 
also forced by the slippage in time frame and reprogyamming of funds,, 
and the availability of personn&l. The ^review of manpower studies and* - 
surveys of fine ar1:s agencies and institutions, also the graphic arts industries 
.were 'accomplished in a limited manner to "determine the kinds of job oppor- 
tunitieSj available." No listings or^ docume^tfation was available or provide'd 

for Auditors purusal a*nd staff statements confirmed that interested tfeachers 

^ r ' ^ • ^ I'' ' . ' ^ 

had accomplished these surveys for ^'their area^* of curriculum development.' 

They i Iso reviewed and determined the type and quality of training, req^uired ^ 



for en,tty level jobs. The review of ciirricul^ and. material presently -available 
within* the D.C. School System was accried out; by both teacher /tra inches and 
staff. Based upon, statements of the RCA staff and D.C. Sphools staff .personnel 
the development o'f an pverall structure for^ the interaction of the program 
elements Xwhile sharing resouuc^es and facilities) must develop jxiece-^meal 
with thc^ curriculum modules and the program element Implementation. Certainly 
the teacher/trainee and staff have developed a cooperative planning capability. , 
and a sharing attitude during the workshops. * >\ 

ThS development of curriculum Outlines for ^aoh*.ipstructional component 
^within the two career^ clusters was *ch^nged 'in cpnc^ept as r^ecommended iy 'the 
&CA iionsultaats and approved within tl\6^.p. Scbools , staff . After the \ 
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sturaner workshop and with the further development of the staff and planning, 

the determination was made to use cluster programs as an outline of Content 

proposed for each program. These cluster programs were then analyzed to 

state content in terms of desired student competencies and behavioral or 
* 

performance objectives. Th^ original pilot career clusters had been developed 
to present: course description (curriculum outline) , .'Nature of Work statement, 
and a Job Opportunit*ies statement. The adopted revisions of cluster programs 



displayed the cluster statement to identify the broad program areas, followed 
by thfe detailed program outlines to specify the learning modules and training 
operations. This, development of 1:lusXer .programs was completed .with staff 
approval and used §s a conmion basis for working within each cluster and 
program cluster interface. In Phase H workshops,, the common go^ls and ' 
performance objectives were to be ^evelbped. The RCA staff foynd that the 
time planned for the actual development of the goals and performance objecXives^ 
was generally insuf f icient* §ince m^ch of the training effort had ta be 
directed to 'that of the ^t^chpical training anci-understajiding of statidards 
being stitrulat;^d for statements of.^student competencies ^tid the behavioral * 
or performance objectives'. * • , V ' - " ' 

• . ■• ■ • \ ' ..." 

The develop^^tefTt of^ meaningful program o/ produpttqn activities to ( 
enhance tKe instructional, programs became a p^i^t of the devel6pment of ea\h " 
program outline (operational) and was lef/ to^ tha touchers, conscious response 
'to student learning and praQticals e*:J^eri^ce . ^Further evaluation ot the 
curriculum modules and actbal teaching plans, plus operational training y 
activities -bT the student in the cilassproom^shop^ will b^requi^d . The 
,au.es^on remains, is the student re^:eivlng practical exp^lence in production' 



0 



V 



of materials for distribution to the s,chools 'and community? Learning 

modules development appearis ^to point in that direction. • - 

/ • * ' ♦ 

Student evaluation and evaluative criteria is to be developed aS a part 

of the learning module. There wgs no emphasis place on iristruments appro- 
priate for such evaluation from available sources^u^b^s the schools, 
colleges, institutions and 'industrial organizations. Also there was no 
^vtew conducted for the purpose o^--4e4ermining their possible proper use 
in phis program.' The use of ^b^ial t^sts and other evaluative devices to 
defkrriline student, pcrfonnarfcj/ and progress , in fact", as stated •that they 
."will be. devised", was not accoiHRli^ed during this period. ^. 

The plan for outsjde evalt^xions to be conducted on a periodic basis ^ 

Was not devised. The only evaluatiorK pl-an considered and prepared for the 
" \ * • 

prOgTatn through Phase III was foinn^tive in nature and developed in conjunction . ' 

' ^* ' / / ' • ' ' 

with the Assistant Superintendent bf/Re'search and Evaluation Office, 

'the means for, continuous plaffinimg -for the center aft^r implementation^ , 

of the clusters", ha'd.not been fully devised during this period. The|Principal/' 

Director was of course planning t/o b^ responsive within the overall D.C. Schools 

/ . ♦ ^ • ' • 

stated requirements and control/ planning procedures. 

Program promotion and pubMc relations were not? being pressed, primarily 

i 

due* to time, table sty^ch out alid because of the re/ention of progr'atn decision 
actions regarding tpe center ^nd i^mplemer^(^a^jl^n at the B.C. &cfio6l staff , 

thi^. "lack of faith" in their capabilities of 
litude aisoi appeared to have effe^ct^on the , 
development of student ^n^transportation schedules for. Yall 1974-75 imple- 
mentation. 



level* t^iHchers complained of 
program -develppme^it . .This a 




I 




Workable schedules for the feeder High schools interface of students 

^ring to attend the Center were proposed for consi-deration within the 

^'transportation network and Metro schedules (items no. 8 and 10 of letter tif 

assurance to USOE) . 

The deve4.opment of a review of unit requirements for electives, with 

respect to overall requirements, for 'graduation, was yet to be accomplished. 

as based upon developed curriguliim and its evaluation The'effort to 

obtain maximqm credit ^or the center studies will be strongly pursued by 

the Principal/Director and his staff. . . . ' 

, Selling of Students products created in the sttfdios, laboratories 

and worjisjiops, is still in the planning stages. The .developH\.ent of a "store 
I - ^ ' * . . • [ ^ • 

is a |oal of the Center development, but like many items, (requires space 

allotation^ Management of facility and the space availability for "cUce-to- 

hav^" items may dictate omission of this plan for a store or sales .Outlet.. 

T^e Principal/Director and^ D^C. Schools staff are continually .fk|vel6p- 

ing and/or jnqdify^n^ .the schedule arid time table for accomplishing t/ne 

stated* goals and' objectives of the Center.', The goals and objectives have 

been written up, accepted and implemented for tlva Center. Initial target 

dates of the time table have already suffered 6np years slippage as pre- 

-V . .- ' ' 

viously discussed. - ♦ * ^ . • f 

The requirement to pl^n anc organize, a counseling service for the ' ' i 
Cente^p had not be&n fully addrifes sed within the certers planning, by 'end of \ 
Kay 1974. This was^a planned/ actio^ ^f or the Center staff and was expected 
to be corelated witjh the overall counseli^i^'g Vrogram for^career development 
witltin the fir'st semester 1974-75'. '/w* ' ^ / 

/ 9d ». 



Staff requiremeats and pe^-sonnel qualifications wer*e| reviewed first 
in the spring and during the summer 0^1973 by the Acting Director and D,C. 
^chool staff. Upon his, Assignment. in November 1973, the Principal/Director 
reviewed these requirement and the qualifications assigned or tentatively 
assigned personnel* Staff development needs were initially responded to 
through the RCA workshops ^nd follow^ up training. An in-service program 
ts pianped. A' procedure for i^cruiting staff for the Center has been ^ 
developed by the Prilncipal/Director • ^ J*'' ^ 

The development of advisory comi$ittee$. for the pilot clusters renlains 
to be accomplished. Our copimittee wccfe organized ^and partially functional 
in the communication and media cluster program (printing). The Principal/ 
Director and his staff will now have to spread their already over J^gaded " 
effort in-order to approach and^obtain committments to serve fj^fem re{>resen- 
tativeS of the Boa^d olf Trade, Civil Service Commission, local business 
and industry, cultural institutions and^ agencies , and v^ithin the. public 
and private schoo^Ls, These advisory ct>mmitt^es represent "^a major develop- 
ment and planning project for the* summer and fall ^974. The committees 

' - - • . ■ • 

should pliy major role in. assisting with the on-go^itg evaluative process^ 

\ ♦ , ' • 

and in developing cooperative training and placement opportunities, ' With- 
out this vital link to government agencies, industry, Qult^ral agencies and 
schools there will ^ a continued sen^e of "floating^* without 'any direction 
by the Center staff and teachers, 



V 
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6. Audit Connnendations 

The staff of the Educational Division^ RCA Service Company commended 

* 

, for pulling togeth^ a very general training plan, and directing and coordi- 
nating a looselyknit group oY teacher trainees whp, when once pulled tggether 
for the joint ^fort, produced the desired initial learning module products. 
Fomiat standards and procedures adopted were principly those of the RC^ staff 
and we would expect sor^ modification or change as they are adapted to the 



: change as th€ 
il staif experj 



use of the^Lenuel A*Penn Center and Iqcal staff experience. The, RCA sta 

'-met their stated' assistance and training objectives with exceptions S5l the 

formation of the verv ittiporta'nt advisory comittees for-^the curriculum jirograms, 

Mr. George Gordcm has dorre an* outstanding job of pullipg the project \^ 

together and providing the highly necessary leadership ^r the 'Center since 

his assignment as Principal/D^ector in November 1973, Working extended 

hour/ and initially without clerical assistance, Jte pulled the new staff 

together and gave then a real sense of directipn. His appearance is that of 

/a good leader, fair and just in his personnel management decisions and most 

all> very knowledgable' in the goals and objectives of the Career Education . 

development. We expect that the growth and successful development of the 

Lemuel A. P^n Center will in great detail reflect the strengths of this 
t 

educational leader. 



V 7. Audit 



Recommenda t ions 



(^That any replicatipn of t^jis planning ^nd evaluation procedure for project 
development be considered would certainly not be recommended. Had the effort 
been expanded to a curriculum and staff development pl&n of perhaps one or two 



years duration, with assigned staff, curriculum development 'specialists and a 
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\ more thorough evaluation of local capabilities, requirements for support 

and comunity assistance would ha-ve assumed greater succe^. ^The attempt * 
to complete and implement curriculum modules for two rather extensive pilot 
program clusters, in such a short time period could but pre-destinate a failure 
or, at best, only partial success. We would recommend consideration of a 
plan which would assure a mire meticulous and thorough project development. 

A. Initial planning must include an interest survey of the student 
, ' • interest in' a planned program which will provide them with pre- 

requisite skills and knowledge for post secondary technical educati'^n 
or entry level jobs. The priniar>- goal of this project should be Co 
^ develop such a program around the' local student ne^ds. 

B. During this first year's phase, a classification and quantification / 
-of the D. C. students in terms of their interest in communication 

I ■ 

' and media; arts and humanities occupations,' both technical and job • 
entry skills and training, should ba accomplished. Tlie proposed 
curriculum outlines and areas of occupation skills woyld be mea^red * 
for definition of student interest or requireme^, 

C. Kext, ve feel there should be an' identification of the existing 
technical occupations in the proposed or needed career ^clusters in ^ 
the District of Columbia, these clusters might well change dramati- 
cally oVer those presently chbsen for ]p>ilot career clusters by the 

^^^^ D. C. Schools" staff / ' ' 

4 • 

D. There should follow a deternlnation of the number of present and 
■"anticipated position^ in each identified technical. or career occupsCtion. 
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E. A determination of 'the requisite skills and knowledge associatjed 

^ with each idenMfi§d technical occupation would then follow. • 
f. Course content^/in post secondary technical education pro|Tams 

would then be assessed to coisplete the first years Phase I activities 
The second year, project Phase II, woylti program the' following activities 
for conpletiore:^ , ' ' . 

A. In depth assessment of the existing curriculum as to: 1) contend 
(skills/knowledge taught), 2) ^ef fectiveness, 30 cost, 
^evelopnent of performance objectives with, representative criterion 
test measures for courses in technical and career skills and know- 
ledges. These objectives developed may not necessarily be a complete 
listing of those which should be included in the courses. 
Development of specialized curriculum modules and teacher guides 
^or selected courses for technical and< career education studepts. 
Produce and disseminate a technical- "Career course guide for the 
D. C. Schools. This gui^e would provide counselors and Students 

• / 

with detailed infonnation-and guidap<:e on program paths for tho;se 



b\ 'I 



/ 




f who aspire technical job skill training and post secondary technical 
education. It would also serve as a guide for C^re^r Education K-10. 
Phase III of this r^ecomroended model would provide program installation 
with the following major tasks to be contplet;ed: 

A. Orientation of the community to Career Education and technical job 
training* educational process. 

B. Implementation and validation of the specialized courses. 
C» Supjjiem^ntary curriculum development aod expansion to new career 

fields as needs requirements dic^te^* ^» \^ 
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There was no specific information or data available to the Auditor/ 
Evaluator in the humanities area. Music appeared to have been -dropped 
from the arts cluster and is known to have been included in the impl^nentation 
of prograi<["nodules at Western High School. Therefore we recommend a very^ 
thorough review of the Lemuel a. Penn Career Clusters in order to insure ' 
that system, wide duplication has* been eliminated, unless student learning 
needs dictate multiple programs. N^eds assessment should be m^d^ each year 

> • • . 

within each 'Center' and system wide in order to assure continued effectiveness.- 

» 

and elimination of duplication or iJest utilization of available educational 
resources.. It is fujther recommended tha^ other student needs within the 
major program areas of Business, Social Services, Engineering and Ifrrdustrial 
/ and HeaUh fields be surveyed where concentration on so called "ha^d" skills 

^ . ■ • " / 

and pctet secondary job entrance would more readily provide employment and 

satisfy community needs than that of the arts and humanities clysters presently 

/ 

/ 

b^ing .developed . , ; 

Tl)*e Lemuel A. Penn Center Principal/Director and staff /Sre encouraged 
.'to immediately follow, up and establish the required Communi/y Advisory Coip- 
^it fot the'variou$ career clusters. They should" identify available 

■ ■ " " ' ' K 

community resources and assistance available to their center, and encourag^v 
a clpse bond of .assistance with community, D. C* government and federal 
government agencie*s. ^ 

Federal guidelines for special ^rojfect grants and monies to support 
such projec.ts at t>hese are necessar/Lly quite de(>ailed and require under- 
standing and capefpl -.attantipri by'^'l(?ie. Project ector , the local, level. 
W« recommend that submission oi piroposals, letters '^of and required 



attachments be carefully prepared and then reviewed by a more knowledgable 

/ 



I'.O . 
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thir*d p^rty prior to* sub^ssion. This sane action sbould.be applied to 

change justification and reprogi*animing actions in order to eliminate extended 

delays of Federal teview and approval action. Initial delays at USOE in the 

project approval (g^rant) and later approval action for funding anc^^Teprogram- 

ming actioa had dir-ect effect upon project time lines and successfurl comple- 

tion of objectives aqd grant requirem^ts. 

It is recommended that the' program evaluation within tfie center be fully' 

considered and procedurally established as one of the first semesters orders 

of business by •the Principal/Director and-ataff. We* \^uld furtjifiirecommend 

that an ^'outside" third partv evaluator Be brought into use order to assess 

the.^continping, development of the Center, 

,The continuing review of resource* sharing and interaction of program 

clusters is an interna^ evaluation .requirement «for the Principal/Director 

and his staff. It is recommended t,hat as the curriculum extensions are de- 

velqjped that the concomitant sharing of resourqes^and learning teaching 

' experieiices J)e ^larged upon. This will be particularly valuable as applied 

across the D^: C. Schools* master planning system. ' ^ 

We would recommend that within the curriculum program clusters that each 

model developed assure the establishment of stated leart^ing or behavioral 

objectives; however, more importantly, there should be a clear statement of 

measurable criteria and the criteria ref er^oce-^tes'&lng (CRT) procedures. 

wiiir-'be'alT impbrtant in* evaluating the pro^iifiX-^'C^sttid^MfHcearriifig and * 
. . ^ *^ ^ " \ 

job placement . ^ \ 

The common goals and performance objectives of curriculum module^ in 
deve>opment were hurried ov^r and we feel not adequately developed for the 
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career clusters. Therefore, it is recomaended that in /conjunction with 

dgvelopment of the CRT program above, that a staff task force be appointed 

for the Center to review.* and establish validation of the cbnimon go6ls and 

performance objectives • Refinement and development of a "tighter" and more 

meaningful goals and objectives statement will undoubtedly fesult. The* 
* 

CRT^s will measure and place neelied change and program, success • 

' • - 

We recommend that the Principal/Director and stgftalso Concentrate on . 
tfi^earning jj^ograro- whiltfT' develops maximum "hands on" experience in the 
production of thin^gs. Further , ^this prj)ductivity must serve the needs of ' 
the schc^l syster, and community in order to-be truely a successful program, 
stimulatin^to the Reamer — useful to tjie system and community. 

The (development of a Center Curriculum Guide and itSv distribution, 
both system .and community wide, is highly recommended. Such a gui<le is 
necessary for guidance services and fdr student information programs; 'as 
^ well as, the general public information program yet to be developed for 
the center. - .* ^ . 

A curriculum review committee' should be established to perform required 
review and ceftif ication-^of career education electives and overall 'requirements 
for graduation, within -ttJi^ D\ C. Schools System. The Principal/Director and 

staff should pursue availability of maximui^ (yipdit f or""stu(!e1Tt!s pursuing the 

- ^- ' • — ' 

^•^T 'ca'reer .education' program electives. ^ 

Space availability will dictate*the ojJeration of a^"store" sales outlet 

* * f 

• for items produced within the student training programs. Ve recominend^ that 
thi& idea of a store be continued wtth every effort made to ensure such an 

O V '* 

"outlet for student product sales. 
* * * 

♦ t 
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The Center counselling program must be developed and implemented * • 
within this-first semester of* operation; in^art, has already been planned, 

* i 

but requires? correlation4with the overall, counselling program for Career*' 

• V. 

Development, D. C. Schools, ^ ' v ^ - 
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SECTION IIli-S¥MMARY 
•a: '?ind,ings . \ «' ' ' 

■ ' • • A 

The findings* sximmarized hefein are presented in tvo parts: ^ those 
related to the "evaluative conclusions (Section IIA, part 5); and those 
related to Xhe* audit conclusions' (Section IIB, paft 5). 

1. Evaluative Findings 

*' ' ' 

a. that the building site,.thfe former National Geographic Building, 

has. been renovated and de'signkted the LenKiel A. Penn Centex. 

b. that the overall approach to, and planning for this pro^j^ct was 
too gt^nd and extensive in expectation of the very limited tinf^ table. . As 
initially ^lonceived the six -week conference meeting would have been too . 
short to accomplish the many objectives. Certainly the three workshops as 
Actually presented, fell short of the uetespa^y citt'riculum develppment and 
Btaff maturation. 

^c. that^du9 to extensive program' de]^ays,* contracting and work ^Sel^ys 
on building renovation, the implementation of the" career education program .* 



/ 



within the Lemuel A. .Penn Center was delayed until school 'year ^.974-75. 

d, that the "intensive period of training and *cijrriculum planning" 
'was modified for one two-week period, summer of 1973, 'followed by one 

week tn JFebruary 1974. Training and planning thus oftered^over an extended 
period of time reduced continuity and since It was conducted during the 
school year, some designated teachers could not attend the wqrkshopa. 

e. that the concept an3 curriculum in development waS a mbdificaMqn 
of career education as is commonly defined in education circles. This career 
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center is to provide students .with a choice of vpca 



tional-technical crain- 



ing courses within their "strong interest and job aspirations." The thrust 

of career education within the D.C. Career master plan i^ ;to provide "entry 

\ 

level" 'job skills. ' ^ , ' ^ 

f. that the tnstxuinents of cotranuaication of the status of project 
development: space^ allocations ; -program and curriculum 'offerings proposed; 
review of relevant materials and review of prt)posed plans for renovation was^ 



Slow to arrive at the teacher' level — and communication ha^^ been dWayed unt^. 



ha^^ been cS^ayed unti^ 
the Phase I workshop' in August 1973. There ^as immediate delay and mucl^ 
frustration while the instructors reviewed relevant materials and discussed 
proposed programs with knowledgeable personnel in the various fields. Addi- 



tionally, these affected instructor^ needed to tour th^ Center (building) and 
review the^ proposed plans for renovation. .Extensive review of proposed 
programs, needs, type and quality of instruction-education required 



/for 

"entry-level" jobs and outside sources of information were required to be 
carried on ^outsjde of the workshops. Advance preparation and coor4ination 
had not been properly accomplished. 

r 

g* that the teacher/trainees review of building renovation and proposed 
plans for internal space assignments for the various' instructional programs, 
in addition to their recommendations for change and reallocation of space, 

cost stated program objectives time of approximately one week, this additionally 

«, » •* * • 

shortened the training and curriculum development time. Much valuable time 
* * • * 

waj5. lost to th£s renovation survey by teacher/trainees and staff. 

tljfe' Philosophy and Goals Statement and course descriptions 

presented in t\\e RCA' Final sRepprt (Summer Workshop) were not made available 

— \ ' * * 

' > \ • > 
» ■ . / 
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to the^^ch^r/trainees until ^the Ph^se II workshops, Spring 1974». 

i. that the Phase I Conference (workshop) 'wis no't\ conducted and 
accepted by the trainees as , stated in reports, but somewheir^in a mlddl^ 
activity position of quality and .completion' of oBjectives: Certainly tj^e 
loss of at least 50% of the ♦^taff training and curriculum develapfeent time 
to^facilities survey and space allocation change recommendation, did little 
to further curriculum- deveJLopment . Jt did have some effect Irx preparation 
of staff cohesiveness and team work. 

j. that the major listed product objectives of the Curriculum and 
Staf| Development were accomplished , in part^or in their entirety by Che RCA 
Service Company staff with the exception ^of the establishment of axivispry ^ 
committees for each cluster program area. ^ 
I k. that the develop||ed and approved program clusters and program 



outlines focused primaril}^ jon the £ine arts as opposed to the*^ humanities. ' 

hat space 



Mitsic was not completed ana program development staCus was such tha 
'limitation might cause an .expanded music program to be droppe^d from' the 
curriculum. . - . / . 

• • • • 

1. that the delays and changes to meet the ^eeds of the project as 
encountered during th^ summer conference (workshop), dictated further change 
and contratt modification for th^ RCA ^^Irvice Cpmpany. The RCA st^f and 
Project Director ^dded new objectives and required assistance to th^^ State- 
ment of Work. This afition furthec condensed the curriculum and staff devel- 
opment training time into specific items to be covered wi.thin the remaining 
two onerweek workshops available. Review of relevant curricula and related 
materials collected by the school personnel have to be incorporated as an 
on-going activity during ,the workshop periods* 
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m. that the Phase II workshops conducted by the RCA staff functioned 
more smoothly than that of ?hise 1. Da^ly schedules were prepared and dis- 
cussed with the teacher trainees and a broad' based programming technique provided 
for flexibility and yet a structure for logical prog^ression of the training. 

n\ that the curriculujn and staff development tr'aining conducted was 
satisfactory. Attendanc^ was somewhat below stated objectives and assigned 
space and facilities were\ ionsid^red poor. Seating arrangements and tr^J^nee 
J attention was' not as high a6 might be expected due to these poQr conditions. 

f 4 N 

o. that the workshops presented -a deeper insight IJito. curriculum . 

development and <:he whole probleto of co;npetency-based instruction that that 

• ( •' ♦ 

4 

which trainees h^d been previously exposed to. Acceptance and *'use-rate" 

c 

will vary greatly within this small group of trainees^ even though the prepared 
materrf.iSils and procedures will ^Jrovide a standardization of format and proce- 
dufe If ac^pted. . • > ' * | 

p. that the assignment of a full-time Principal/Director made definite 
managerial advances as well as having a sJttliijg effect on the conduct of ^ 
^he worksHpps and staff development. | 

q* that the period of trainees workshap activities and RCA Consultants 
advisory activities Was gomewhat short to be truly effective, particularly for 
those trainees with onXy- technical backg;:ound and teaching experience. / 

r. that the designated program ,t,eac||(|Lrs were concerned with the prjo- 
cedure of returning to their regular classij^boms and J.nstructlonal duties, 
while e^xpected to provide services to^ the ^u^iculum committee for the Center. 
They were concerned about additional workload on nights and weekends, or the 
^ possibility of spending a summer of program work without stipend. 
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. 8. that tke project teache^rs aijd' teacher control group responses to- 

mailed out questionnaires from the Auditor/Evaluator were very disappointing. 

Not only .delayed in response time.; but, providing a very small samplepf 

• ' • * 

.respondents. Discussion of findings based upon the' questionnaire are found ^^-^ 
In number 5 on page 46 of this report. 

2. Audit findings * • \ 

a. that the project, the planning and evaluative capabilities for 

the implementation of a high school level career development program is one 

year behind the proposed and planned project implementatiorwiate. Major 

t delays were ^attributed to securing government funding and reprogramming of - 

fund^; delay it) securing consultant assistance and Contracting; and t^e late 

bidding, contracting and work delays in the renovation of the Center facilities. 

> \ * e that the project success was spmewhat delayed by the fact that a 
« 

full,tl?ne Principal/Director was not /Initially available to "lead'' the personnel 
and staff or thje cro§s-staff coordination of project activities*^- • . 

c. that the proje^^management' actions were nit completely planned^ 

nor was therA>a complete jSroject master plan developed. The "model" of ' ■ 

administrative actions ^nd interrealted approvaffsv^^C. Sciiool Staff, to. \ 
D.C. Government, to Federal Agency Office, and- return, which verj^ involved in. ^ 
this project, was sufficient to delay the prroject. The heavily/ iayered super- 
vision and "control" approvals during this first year i:ontioue/a tlj^Ls delaying 

effect. • * ' . ./:. * . ; . ' 

d. that the planning and monies made avail^abTe to the^project were 
insufficient to ensure meeting the needs of the D.C. School ^personnel invo^ve^ 
in the project, as well as, the stated staff development or ^curriculum ^ 
development necessary. 

lv,'8 



itions ^SpWialist faile 



e. that the^CA Community Relations Specialist failed tbmpletely to 
follow up and establish the very important Community Advisory Comm^ittee 'a'nd 
to identify community resoutces.. , 

f. ' that the structured procedures for development of curriculum 
mpdules and the afesistanc| in modular program development ^d technical 
vnriting is the liost valuable RCA staW contribution. 



g. that the Center ^taff was behind schedule as of Ma^ 15, 197A 
with the curriculum development tasks a4 only Approximately eigtit percent 

• , » . * / 

of the approved programs were found to be igr some modular form, identification 
or w^itifig. 

. / 

) ^/^* that the model for the program evaluation within the center is 

* adequate for present planriing requirements a\id will be further developed 

with practice and ^operational experience. Objective task measurement of the * 
learning process was assured within the curriculum module format* 

i. that a limited si^rvey of agencies a*nd institutions wks accomplis^jpd 
by the teacher-trainees in order to determine ■ the "kinds of job opportunities - 
- available" and also the review and determination of the type and quality of 
'^training required for entry leviej. jobs." . • 

j. that the "structure for interaction of the program elements 
(while sharing resources and facilities) must develop piecfemeal with the 
curriculum modules and the pr'ogram element implementation. 

k. that the initial concept of use of curriculup outlines was Replaced 
jipjfy^ tfce use of "cluster programs" as an outlin'^of content proposed for each 

Cluster programs were J^ere analyzed and stated in terms of desired 
it competencies and then, rin behavioral or pejrformance objectives. The 
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'learning system and teacher may then be held accountable for teaching the 
competencies and exposure to student behavioral patterns desl,red and necessary 
to meet performance objectives of the tech^ic;al skill 01^^ career entry level 

4 V * \ V 

job. 



)X^^ ca 




1. that the time planned and reprogrammed for the J'hase II workshops 
^as insu^i^ient to fully cojrer comaon goals and performance objectives, 
which were to be developed for the curriculum training effort had to be 
directed touarc technical writing training and the understanding of standards 
being stipulated. 

m. that th^ development of. a meaningful program of production activities 
to enhance the instructional programs, became a part of the development of ' . 
ea~ch program outline. They ar^ to be further developed by each teacher ^ 
and will require further evaluation b^sed upon curriculum modules, actbal 

I ' .'. 

teaching plans and operational training and classroom* activities ^ 



n. that student evaluation and evaluative criteria Is tq be developed 

as a part of each learning module. Emphasig was not placed on apprdpriate 
» 

instruments available from othe;> institutions and indicstry, or .business 
training programs. review of possible proper use of such instruments in 

this<program was also omitted.^ Special tests and other evaluative devices 
weife not devised as had been planned. 

o. that the plan for outside evaluations toi^be periodically conducted 
within the center was not devised. Only an internal formative evaluation 

« 

model was designed and planned for implementation. 

* % • 

p. that the means and procedure for continuous planning for the 

Center has yet to be fully developed. Jhe Principal/Director is planning 

upon being responsive to central planning procedures and requirements of the 

D»C. Schooll Boaird Staff. 
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q. I thax Center program promotion and public relations were not receiv- 
ing desired or required emphasis within the comm'unitj^ and particularly the ^ 
prospect/ive ^tudint career education participants. 

r. thaty the review of unit requirements for graduation was yet to^ 



be accomplishen, based upon develo{)ed curriculum and evaluation. Maximud 
credi^t for center studies must be strongly pursued by the Pr'incipal/Director-^ 
and staff. / , 

s. that the establishment of a "store" sales outlet for' student 

/ ' ' . 

generated products is a nice-tb-have goal which may have to l?e abandoned 

for.lfick <if space availability and operational cost. 

/ 

t/. that the PriticiBal/Director and D.C. Schoql- Board St;aff are ^ /'^ 

/ * « * ' ' ' 

continually developing and/or modifying the schedule and time-table for 

accom|5lishing the stated goals and objectives of the Center^ Gopd planning 

and" management practice should provide needed sj^ability in this 'area.' 

u. that the required planning to organize a counseling service for 

thef Center had not .J>een full^y acc«^plished. Wh^n developed^ it must yet be 

col^related with the overall counseling program for car-eer development. 

V. that the Center staff requirements and personnel acti6ns were 

rejvi^wed by the Prirfcipal/Director . That teacher qualifications and staff 

development needs were initially responded to in the Phase II workshop; and, 

that an in-service program is planned. Staff recruitment procedures have 

be^n developed for the Center. 

w. that the developaient of advisory committees for the progi:am- 

clud^ters remains to be accomplished by the Center staff. 




ERIC 



111 



106 



/ 



. ■ / ^- • • • ■ 

.B. Commendations / * 

The c^nftnendations herein summarized arp o^esented in two parts: those 
related to the evaluative conclus%ohs (See numl/er 5 on pa^ge 46); and those 
related .to -th^ audit conclusions/ (See number ^. ori page 82). 

1. ' Ev4l uative Commendations 
, 

a. the Acting Ptoject/ Director Is (jommended for his persistance, 

even though -he waSs^only abli to provide a ^"parbstime" effort early in the 

project to insure initial /rojecT'^c^^J^y/ion and a smooth implementation 

of the LemUeL A. Peian • Cer/ter. * 



b» ttie IICA Service Company's fflui^Iipnal Division Staff is (x>mmended ^ 

\ ' ' ' " ' - 

for meeting a most (difficult training si|fuation "head-on" and retaining their 

composure a'^d flexibility.^ They were quite successful in meeting all established 

objectives wiVh only oiie exception. ^ < 

c. the I>,C.. School Board and Staff are comniended for establishing ' 
this Career Education CenteK and others in the stated master plan, to provide 
students an expanded shopping A^t^^f^ocational and technical training programs. 

d. the t/eacher /trainees s^^ected for the Center staff are commended for 
maintaining thsir composure and dedication to the project and the school 
system evjan ir^ the face of the manV deR^^ and program changes. 

e. tye RCA Educational Seruices Diyision was well equipped with ^ ' 
excellent training materials and workshop hanH^outs. It is highly commendable 
that the RCA staff was able to draw upon su6h a \arge reservoir of materials, 
subject b^$ed upon previous or currently on-going contracts similar in nature. 
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These mat^ials and -tk^ staff presentation proved ta be most helpful in fulfilling 
the curriculum development process for the Center. 
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2. Audit Commendations 

a. the Mucational Division Staff, RCA Sercice Company is commended 
fo^ ptilliug tojth&j: a ratheW vague training plan and for organizip/ a very 
cohe^iv^ teachfer/titinee ^group. Initially goirlg their individual ways,\the 
teacher-train^^s we^ taught the need for*staff team-work, were presented with 
ideas and retomnehddtlons ^or stamdards^ formats and procedures and through 



t 



their joint /effort , produced, the de'sired intial learning module products, 
b. /the .Principal/Director is commended for his outstanding job of 
pulling tl^ CenteV projetct together after his late assignment and for providing 
the necessary leadershi-p to the' Center staff. We expect a successful growth 
^nd development pattern of the Lemuel A, ,Penn Center will reflect this 
educatiohal leaders stlrengths. 

€• Recpmmendations . . ' * 

The recommendations herein summarized are presented in two parts: 
thdse related to the evaluative- conclusions (See number 5 on 'page 46);, and, 
those related to thfe audit conclusions (See number $ on page 823, 
. 1. Evaluativ^ Reco mmendations 

a. *the overaXl\ program plan and stated project objectives were too ♦ 
extensive to be accomplished iti the time period initially programmed, Ve 
recommend that ^ complete\ reprogramming and project plan be developed before an 
attempt at replica'tion b^ tii^de. 'a three Phape, in-house curriculum and staff* 

*• developbept program shodld bV considered." *A meticulous development of the 
^.career education center shoulk allow for a two year construction and/or rend^ 
vation plan for required facility availability. 

b. that all selected 'teacher/ trainees be ttained in the workshops and 
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not by second and third hand infonnation "passed on" by one who is attending 
the sessions. We recommend program of adequate funds and substitute teachers 
to insure ^tHat the select; teachers attendance ayailability • Also in this 
respect, ear'ly pJt^nning ;t)f ^traipin^ workshops in order that suffici.ent lead- 
time notice can be given the teachers in order to insure availability for the 
summer sessions. 

c. that the D.C. School st^ff give due consideration to the augmentation 
of the Master Plan of Career Centers and Vocational Training to include a / 

Career Education Element within all elementary grades K-8 and secondary grafles 

^ / 
9-10. • These Career Education elements of instruction would provide the stiidents 

with knowledge of the various types of 'careers available in the District Jand 

idb skills requ^fed. * • ' ' 

d. that, the ^r^gfinizat ion °f Advisory Committees and Community ^sistance 
to the Car^r. Education pxograms.be made a very .high ^priority action ot pre- 
planning the Phase Ir^f project replication. J V 

e. tfiat co©rdinat;.ion of change Inp.ut to the facility renovati^n/con- 
s true t ion* b? accomplished with the D.C. Schools architect outside tl^ formal 
workshop or in-sfervice teacher trailing programs. 

f» that D*C. Schools and/or Center ?hil^^ophy and Goals st^t^ments, 
^ wheti published , be provided to each staff and teacher incumbent. THat all 
t^eachers .and s^^aff membefrs have, understand and a^ply their educatio 
to fully utilize these published goals- and guidelines. 

^ g. that' ihe selected career cluster p-rograms be fully augujtented » *. 
with completed Jeaming modules and teacher plan^ as soon as poss' 
present' cotiditions. and chat a. decision be* made regarding those clis 

r' 

arts^ and particularly the h]iJmanities which are to bfe retained for 
* Penn curriculum 6r to be offered elsewhere, if at all. 
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^ h» that future conferences and workshops be conducted in a training 
facilfty and acmosphdre more suitable and proper for acTult teacher /trainees. 
That classroom teaching aids and instruction^ hardware be made available to 
the contractor fox his use. , 

^ i. that future planned Curriculum and staff development workshops 

devoted to standard formats; develop- 
ment df the performancfe objectives; teaching and, learning condit|.o^s; student 
evaluation with great emphasis on "measurable'' objectives of performance and 
more -one to one advisory aad correctly^ guidance/assistance. 

• j. that published standard^,^ a policy and procedures manual and 
standard format for lArning modules and teaching plans be established for the 
Center. Provided early enough dn a replication situattoft ' they will circumvent 
much of the research and development time, effort and /expense 'spent on this 
project. ' * ' . ' 

2. Audit Recommendations 

a* that any replication of this, planning and evaluation procedure 
not be attempted. In lieu thereof, we recommend a phasing concept of from 
one to two years in program development, with implementation in the third 
year. We recommend a more meticulous and thorough project development. The 
primary goal should be to develop a pro-am which will provide the students - 
with prerequisitTE skills and knowledges for post secondary technical educa'tion 
or ent'ry level career jobs, based upon known local student needs. (See 
number 7 on page 92). 

.b. that there is need to review present Center program developtbent 
a-nd the. program clilsters which are to be developed in the humanities program. 
There were no specifics availablg^or consideration or evaluation that the 
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decision be made to either drop music clusters from the arts program or that 
currix:ulum development be pursued immediately and space for required inst^uc- 
tion progjbm be made available. 

c. that master plan review by D.C. Schools Staff eliminate via priority' 
assignment of program clusters, the possible duplication of Center program 
curriculum offerings except where student needs dictate multiple efforts. 

\ d. that other student needs be supervised within the nijjor program ' 
areas of Business, Sacial Services, Engineering and Industrial and Health fields. 
It is felt that concentration of these skill areas would more readily provide 
.post secondary student employment and satisfy- community needs more appropriately 
than the arts and humanities clusters being developed. ' • 

e. that a more thorough evaluation of the District Architects Planning 
and Business Offices contract procedure be accomplished prior to planned 
educational program implementation. Some assurance of facility availability 
must he obtained for final timeline planning. \ * 

f . that the Lemuel A. Pean Principal/Dirictor and st^ff move immediately 
to follow up and establish* the req^aired Community kdyisovy Committees for the 



various career clusters. *• \ . . « a. 



g4 that submission of proposals, letters of intent and , required attach- 
ments to the Office of Education (Department of HEW) be carefully prepared 




and then reviewed by a third party prior to submission. ^^^^reful attention ^ 

hy the Projeci^liirector should ensure the same type of acticm^for change 

justification and reprogramming actions. That* every attempt be made to ensure 

completed' action under the Federal Guidelines, for such projects in order to 

eliminate extended coordination or delays. • / 

» • 
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' that, as, new extension of Chd careei; program clixstef| are 
developed and added, the refsource sharing and interaction experiences be 
enlarged upon, evaluated and made available to the D.C, Schools staffs 

!• that each cluster learning model developed assure the establishment 
of clearly stated learnin-g-or behavioral, objective^; mpre importantly, the 
clear statement of measurable criteria and a criteria reference testing (CRT) 
procedur^. ^ 

^ j» that a ^staf f . task force be developed to review and establish \^ 

validation of the common goals and performance objectives for thS'Center, ' 

« 

that the "Principal/Director and staff develop maximum student 
"hands-on" e^erience in the learning modules ^nd teaching plans utilized. 

1. that a Ceilter curriculum guide be developed and given wide distri- 
bution "throughout the scihool system and community, * 

m. that the concept of a "store" sales outlet for student produced 
items be continued and established provided space can be made. available within 
the Center facility. 

n, that the 'Center coufiselling program be developed on a priority 
action basis and implemented during the' first semesters. operation, school 
year 1974-75. That the program be fully correlated, with the ove'rall counselling 
program for the Career Development, D,C, Schools, 
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